Nov 10 16:11:41 user nova-compute[75102]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75102) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75102) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75102) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 10 16:11:41 user nova-compute[75102]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.020s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:11:41 user nova-compute[75102]: INFO nova.virt.driver [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 10 16:11:41 user nova-compute[75102]: INFO nova.compute.provider_config [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] Acquiring lock "singleton_lock" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] Acquired lock "singleton_lock" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] Releasing lock "singleton_lock" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] Full set of CONF: {{(pid=75102) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ******************************************************************************** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] Configuration options gathered from: {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ================================================================================ {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] allow_resize_to_same_host      = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] arq_binding_timeout            = 300 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] backdoor_port                  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] backdoor_socket                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] block_device_allocate_retries  = 300 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] block_device_allocate_retries_interval = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cert                           = self.pem {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute_monitors               = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] config_dir                     = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] config_drive_format            = iso9660 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] config_source                  = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] console_host                   = user {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] control_exchange               = nova {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cpu_allocation_ratio           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] daemon                         = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] debug                          = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] default_access_ip_network_name = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] default_availability_zone      = nova {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] default_ephemeral_format       = ext4 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] default_green_pool_size        = 1000 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] default_schedule_zone          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] disk_allocation_ratio          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] enable_new_services            = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] enabled_apis                   = ['osapi_compute'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] enabled_ssl_apis               = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] flat_injected                  = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] force_config_drive             = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] force_raw_images               = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] graceful_shutdown_timeout      = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] heal_instance_info_cache_interval = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] host                           = user {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] instance_build_timeout         = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] instance_delete_interval       = 300 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] instance_format                = [instance: %(uuid)s]  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] instance_name_template         = instance-%08x {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] instance_usage_audit           = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] instance_usage_audit_period    = month {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] internal_service_availability_zone = internal {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] key                            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] live_migration_retry_count     = 30 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] log_config_append              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] log_dir                        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] log_file                       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] log_options                    = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] log_rotate_interval            = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] log_rotate_interval_type       = days {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] log_rotation_type              = none {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] long_rpc_timeout               = 1800 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] max_concurrent_builds          = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] max_concurrent_live_migrations = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] max_concurrent_snapshots       = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] max_local_block_devices        = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] max_logfile_count              = 30 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] max_logfile_size_mb            = 200 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] maximum_instance_delete_attempts = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] metadata_listen                = 0.0.0.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] metadata_listen_port           = 8775 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] metadata_workers               = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] migrate_max_retries            = -1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] mkisofs_cmd                    = genisoimage {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] my_ip                          = 10.0.0.210 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] network_allocate_retries       = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] osapi_compute_listen_port      = 8774 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] osapi_compute_unique_server_name_scope =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] osapi_compute_workers          = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] password_length                = 12 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] periodic_enable                = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] periodic_fuzzy_delay           = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] pointer_model                  = ps2mouse {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] preallocate_images             = none {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] publish_errors                 = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] pybasedir                      = /opt/stack/nova {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ram_allocation_ratio           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] rate_limit_burst               = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] rate_limit_except_level        = CRITICAL {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] rate_limit_interval            = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] reboot_timeout                 = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] reclaim_instance_interval      = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] record                         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] reimage_timeout_per_gb         = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] report_interval                = 120 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] rescue_timeout                 = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] reserved_host_cpus             = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] reserved_host_disk_mb          = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] reserved_host_memory_mb        = 512 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] reserved_huge_pages            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] resize_confirm_window          = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] resize_fs_using_block_device   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] resume_guests_state_on_host_boot = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] rpc_response_timeout           = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] run_external_periodic_tasks    = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] running_deleted_instance_action = reap {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] running_deleted_instance_poll_interval = 1800 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] running_deleted_instance_timeout = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler_instance_sync_interval = 120 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_down_time              = 720 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] servicegroup_driver            = db {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] shelved_offload_time           = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] shelved_poll_interval          = 3600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] shutdown_timeout               = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] source_is_ipv6                 = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ssl_only                       = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] state_path                     = /opt/stack/data/nova {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] sync_power_state_interval      = 600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] sync_power_state_pool_size     = 1000 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] syslog_log_facility            = LOG_USER {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] tempdir                        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] timeout_nbd                    = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] transport_url                  = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] update_resources_interval      = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] use_cow_images                 = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] use_eventlog                   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] use_journal                    = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] use_json                       = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] use_rootwrap_daemon            = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] use_stderr                     = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] use_syslog                     = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vcpu_pin_set                   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plugging_is_fatal          = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plugging_timeout           = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] virt_mkfs                      = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] volume_usage_poll_interval     = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] watch_log_file                 = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] web                            = /usr/share/spice-html5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_concurrency.disable_process_locking = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.auth_strategy              = keystone {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.compute_link_prefix        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.dhcp_domain                = novalocal {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.enable_instance_password   = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.glance_link_prefix         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.instance_list_per_project_cells = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.list_records_by_skipping_down_cells = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.local_metadata_per_cell    = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.max_limit                  = 1000 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.metadata_cache_expiration  = 15 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.neutron_default_tenant_id  = default {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.use_forwarded_for          = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.use_neutron_default_nets   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.vendordata_dynamic_targets = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.vendordata_jsonfile_path   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.backend                  = dogpile.cache.memcached {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.backend_argument         = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.config_prefix            = cache.oslo {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.dead_timeout             = 60.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.debug_cache_backend      = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.enable_retry_client      = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.enable_socket_keepalive  = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.enabled                  = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.expiration_time          = 600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.hashclient_retry_attempts = 2 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_dead_retry      = 300 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_password        =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_pool_maxsize    = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_sasl_enabled    = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.memcache_username        =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.proxies                  = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.retry_attempts           = 2 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.retry_delay              = 0.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.socket_keepalive_count   = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.socket_keepalive_idle    = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.socket_keepalive_interval = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.tls_allowed_ciphers      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.tls_cafile               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.tls_certfile             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.tls_enabled              = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cache.tls_keyfile              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.auth_section            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.auth_type               = password {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.cafile                  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.certfile                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.collect_timing          = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.cross_az_attach         = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.debug                   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.endpoint_template       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.http_retries            = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.insecure                = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.keyfile                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.os_region_name          = RegionOne {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.split_loggers           = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cinder.timeout                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.cpu_dedicated_set      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.cpu_shared_set         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.image_type_exclude_list = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.max_concurrent_disk_ops = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.max_disk_devices_to_attach = -1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.resource_provider_association_refresh = 300 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.shutdown_retry_interval = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] conductor.workers              = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] console.allowed_origins        = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] console.ssl_ciphers            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] console.ssl_minimum_version    = default {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] consoleauth.token_ttl          = 600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.cafile                  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.certfile                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.collect_timing          = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.connect_retries         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.connect_retry_delay     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.endpoint_override       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.insecure                = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.keyfile                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.max_version             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.min_version             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.region_name             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.service_name            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.service_type            = accelerator {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.split_loggers           = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.status_code_retries     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.status_code_retry_delay = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.timeout                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] cyborg.version                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.backend               = sqlalchemy {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.connection            = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.connection_debug      = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.connection_parameters =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.connection_recycle_time = 3600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.connection_trace      = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.db_inc_retry_interval = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.db_max_retries        = 20 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.db_max_retry_interval = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.db_retry_interval     = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.max_overflow          = 50 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.max_pool_size         = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.max_retries           = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.mysql_wsrep_sync_wait = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.pool_timeout          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.retry_interval        = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.slave_connection      = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] database.sqlite_synchronous    = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.backend           = sqlalchemy {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.connection        = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.connection_debug  = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.connection_parameters =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.connection_recycle_time = 3600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.connection_trace  = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.db_inc_retry_interval = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.db_max_retries    = 20 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.db_max_retry_interval = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.db_retry_interval = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.max_overflow      = 50 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.max_pool_size     = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.max_retries       = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.pool_timeout      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.retry_interval    = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.slave_connection  = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] api_database.sqlite_synchronous = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] devices.enabled_mdev_types     = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ephemeral_storage_encryption.enabled = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.api_servers             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.cafile                  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.certfile                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.collect_timing          = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.connect_retries         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.connect_retry_delay     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.debug                   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.default_trusted_certificate_ids = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.enable_certificate_validation = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.enable_rbd_download     = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.endpoint_override       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.insecure                = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.keyfile                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.max_version             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.min_version             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.num_retries             = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.rbd_ceph_conf           =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.rbd_connect_timeout     = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.rbd_pool                =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.rbd_user                =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.region_name             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.service_name            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.service_type            = image {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.split_loggers           = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.status_code_retries     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.status_code_retry_delay = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.timeout                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.verify_glance_signatures = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] glance.version                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] guestfs.debug                  = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.config_drive_cdrom      = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.config_drive_inject_password = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.enable_instance_metrics_collection = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.enable_remotefx         = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.instances_path_share    =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.iscsi_initiator_list    = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.limit_cpu_features      = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.power_state_check_timeframe = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.use_multipath_io        = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.volume_attach_retry_count = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.vswitch_name            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] mks.enabled                    = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] image_cache.manager_interval   = 2400 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] image_cache.precache_concurrency = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] image_cache.remove_unused_base_images = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] image_cache.subdirectory_name  = _base {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.api_max_retries         = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.api_retry_interval      = 2 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.auth_section            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.auth_type               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.cafile                  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.certfile                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.collect_timing          = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.conductor_group         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.connect_retries         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.connect_retry_delay     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.endpoint_override       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.insecure                = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.keyfile                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.max_version             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.min_version             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.peer_list               = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.region_name             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.serial_console_state_timeout = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.service_name            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.service_type            = baremetal {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.split_loggers           = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.status_code_retries     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.status_code_retry_delay = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.timeout                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ironic.version                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] key_manager.fixed_key          = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.barbican_api_version  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.barbican_endpoint     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.barbican_endpoint_type = public {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.barbican_region_name  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.cafile                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.certfile              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.collect_timing        = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.insecure              = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.keyfile               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.number_of_retries     = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.retry_delay           = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.send_service_user_token = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.split_loggers         = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.timeout               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.verify_ssl            = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican.verify_ssl_path       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican_service_user.auth_section = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican_service_user.auth_type = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican_service_user.cafile   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican_service_user.certfile = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican_service_user.collect_timing = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican_service_user.insecure = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican_service_user.keyfile  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican_service_user.split_loggers = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] barbican_service_user.timeout  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.approle_role_id          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.approle_secret_id        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.cafile                   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.certfile                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.collect_timing           = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.insecure                 = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.keyfile                  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.kv_mountpoint            = secret {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.kv_path                  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.kv_version               = 2 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.namespace                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.root_token_id            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.split_loggers            = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.ssl_ca_crt_file          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.timeout                  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.use_ssl                  = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.auth_section          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.auth_type             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.cafile                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.certfile              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.collect_timing        = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.connect_retries       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.connect_retry_delay   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.endpoint_override     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.insecure              = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.keyfile               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.max_version           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.min_version           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.region_name           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.service_name          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.service_type          = identity {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.split_loggers         = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.status_code_retries   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.status_code_retry_delay = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.timeout               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] keystone.version               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.connection_uri         =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.cpu_mode               = custom {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: WARNING oslo_config.cfg [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.cpu_power_governor_high = performance {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.cpu_power_governor_low = powersave {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.cpu_power_management   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.device_detach_attempts = 8 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.device_detach_timeout  = 20 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.disk_cachemodes        = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.disk_prefix            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.enabled_perf_events    = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.file_backed_memory     = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.gid_maps               = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.hw_disk_discard        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.hw_machine_type        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.images_rbd_glance_store_name =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.images_rbd_pool        = rbd {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.images_type            = default {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.images_volume_group    = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.inject_key             = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.inject_partition       = -2 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.inject_password        = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.iscsi_iface            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.iser_use_multipath     = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_bandwidth = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_downtime = 500 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_inbound_addr = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_permit_post_copy = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_scheme  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_timeout_action = abort {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_tunnelled = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: WARNING oslo_config.cfg [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 10 16:11:41 user nova-compute[75102]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 10 16:11:41 user nova-compute[75102]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 10 16:11:41 user nova-compute[75102]: and ``live_migration_inbound_addr`` respectively.
Nov 10 16:11:41 user nova-compute[75102]: ).  Its value may be silently ignored in the future.
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.live_migration_with_native_tls = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.max_queues             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.nfs_mount_options      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.num_memory_encrypted_guests = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.num_pcie_ports         = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.pmem_namespaces        = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.quobyte_client_cfg     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rbd_secret_uuid        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rbd_user               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.remote_filesystem_transport = ssh {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rescue_image_id        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rescue_kernel_id       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rescue_ramdisk_id      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.rx_queue_size          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.smbfs_mount_options    =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.snapshot_compression   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.snapshot_image_format  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.sparse_logical_volumes = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.swtpm_enabled          = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.swtpm_group            = tss {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.swtpm_user             = tss {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.sysinfo_serial         = unique {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.tb_cache_size          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.tx_queue_size          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.uid_maps               = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.use_virtio_for_bridges = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.virt_type              = kvm {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.volume_clear           = zero {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.volume_clear_size      = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.volume_use_multipath   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.vzstorage_cache_path   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.vzstorage_mount_user   = stack {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.auth_section           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.auth_type              = password {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.cafile                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.certfile               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.collect_timing         = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.connect_retries        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.connect_retry_delay    = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.default_floating_pool  = public {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.endpoint_override      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.extension_sync_interval = 600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.http_retries           = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.insecure               = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.keyfile                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.max_version            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.min_version            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.ovs_bridge             = br-int {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.physnets               = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.region_name            = RegionOne {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.service_metadata_proxy = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.service_name           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.service_type           = network {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.split_loggers          = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.status_code_retries    = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.status_code_retry_delay = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.timeout                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] neutron.version                = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] notifications.bdms_in_notifications = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] notifications.default_level    = INFO {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] notifications.notification_format = unversioned {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] notifications.notify_on_state_change = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] pci.alias                      = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] pci.device_spec                = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] pci.report_in_placement        = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.auth_section         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.auth_type            = password {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.cafile               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.certfile             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.collect_timing       = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.connect_retries      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.connect_retry_delay  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.default_domain_id    = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.default_domain_name  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.domain_id            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.domain_name          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.endpoint_override    = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.insecure             = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.keyfile              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.max_version          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.min_version          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.password             = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.project_domain_id    = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.project_domain_name  = Default {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.project_id           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.project_name         = service {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.region_name          = RegionOne {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.service_name         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.service_type         = placement {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.split_loggers        = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.status_code_retries  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.status_code_retry_delay = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.system_scope         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.timeout              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.trust_id             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.user_domain_id       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.user_domain_name     = Default {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.user_id              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.username             = placement {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] placement.version              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.cores                    = 20 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.count_usage_from_placement = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.injected_file_content_bytes = 10240 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.injected_file_path_length = 255 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.injected_files           = 5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.instances                = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.key_pairs                = 100 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.metadata_items           = 128 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.ram                      = 51200 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.recheck_quota            = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.server_group_members     = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] quota.server_groups            = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] rdp.enabled                    = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.image_metadata_prefilter = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.max_attempts         = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.max_placement_results = 1000 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.query_placement_for_image_type_support = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] scheduler.workers              = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.host_subset_size = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.isolated_hosts = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.isolated_images = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.pci_in_placement = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.track_instance_changes = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] metrics.required               = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] metrics.weight_multiplier      = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] metrics.weight_setting         = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] serial_console.enabled         = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] serial_console.port_range      = 10000:20000 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] serial_console.serialproxy_port = 6083 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.auth_section      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.auth_type         = password {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.cafile            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.certfile          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.collect_timing    = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.insecure          = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.keyfile           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.send_service_user_token = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.split_loggers     = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] service_user.timeout           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.agent_enabled            = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.enabled                  = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.html5proxy_port          = 6082 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.image_compression        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.jpeg_compression         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.playback_compression     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.server_listen            = 127.0.0.1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.streaming_mode           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] spice.zlib_compression         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] upgrade_levels.baseapi         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] upgrade_levels.cert            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] upgrade_levels.compute         = auto {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] upgrade_levels.conductor       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] upgrade_levels.scheduler       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vendordata_dynamic_auth.auth_section = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vendordata_dynamic_auth.auth_type = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vendordata_dynamic_auth.cafile = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vendordata_dynamic_auth.certfile = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vendordata_dynamic_auth.insecure = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vendordata_dynamic_auth.keyfile = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vendordata_dynamic_auth.timeout = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.api_retry_count         = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.ca_file                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.cache_prefix            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.cluster_name            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.connection_pool_size    = 10 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.console_delay_seconds   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.datastore_regex         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.host_ip                 = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.host_password           = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.host_port               = 443 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.host_username           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.insecure                = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.integration_bridge      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.maximum_objects         = 100 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.pbm_default_policy      = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.pbm_enabled             = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.pbm_wsdl_location       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.serial_port_proxy_uri   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.serial_port_service_uri = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.task_poll_interval      = 0.5 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.use_linked_clone        = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.vnc_keymap              = en-us {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:41 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.vnc_port                = 5900 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vmware.vnc_port_total          = 10000 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.auth_schemes               = ['none'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.enabled                    = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.novncproxy_port            = 6080 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.server_listen              = 0.0.0.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.vencrypt_ca_certs          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.vencrypt_client_cert       = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vnc.vencrypt_client_key        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.disable_rootwrap   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.enable_numa_live_migration = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.libvirt_disable_apic = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.client_socket_timeout     = 900 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.default_pool_size         = 1000 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.keep_alive                = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.max_header_line           = 16384 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.ssl_ca_file               = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.ssl_cert_file             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.ssl_key_file              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.tcp_keepidle              = 600 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] zvm.ca_file                    = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] zvm.cloud_connector_url        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] zvm.reachable_timeout          = 300 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.enforce_new_defaults = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.enforce_scope      = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.policy_default_rule = default {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.policy_file        = policy.yaml {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.connection_string     = messaging:// {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.enabled               = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.es_doc_type           = notification {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.es_scroll_size        = 10000 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.es_scroll_time        = 2m {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.filter_error_trace    = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.hmac_keys             = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.sentinel_service_name = mymaster {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.socket_timeout        = 0.1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.trace_requests        = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler.trace_sqlalchemy      = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler_jaeger.process_tags   = {} {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler_jaeger.service_name_prefix = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] profiler_otlp.service_name_prefix = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] remote_debug.host              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] remote_debug.port              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.ssl      = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_notifications.retry = -1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_messaging_notifications.transport_url = **** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.auth_section        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.auth_type           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.cafile              = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.certfile            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.collect_timing      = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.connect_retries     = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.connect_retry_delay = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.endpoint_id         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.endpoint_override   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.insecure            = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.keyfile             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.max_version         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.min_version         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.region_name         = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.service_name        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.service_type        = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.split_loggers       = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.status_code_retries = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.status_code_retry_delay = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.timeout             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.valid_interfaces    = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_limit.version             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_reports.file_event_handler = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] oslo_reports.log_dir           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_ovs_privileged.group  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] vif_plug_ovs_privileged.user   = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_linux_bridge.flat_interface = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_ovs.isolate_vif         = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_vif_ovs.per_port_bridge     = False {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] os_brick.lock_path             = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] privsep_osbrick.capabilities   = [21] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] privsep_osbrick.group          = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] privsep_osbrick.helper_command = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] privsep_osbrick.user           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] nova_sys_admin.group           = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] nova_sys_admin.helper_command  = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] nova_sys_admin.user            = None {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG oslo_service.service [None req-4015bfee-ff50-48f0-bd44-22bed5c49aef None None] ******************************************************************************** {{(pid=75102) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 10 16:11:42 user nova-compute[75102]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 10 16:11:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Connecting to libvirt: qemu:///system {{(pid=75102) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f5f85d47010> {{(pid=75102) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 10 16:11:42 user nova-compute[75102]: libvirt:  error : internal error: could not initialize domain event timer
Nov 10 16:11:42 user nova-compute[75102]: WARNING nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 10 16:11:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f5f85d47010> {{(pid=75102) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Starting native event thread {{(pid=75102) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Starting green dispatch thread {{(pid=75102) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 10 16:11:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Starting connection event dispatch thread {{(pid=75102) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 10 16:11:42 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Connection event '1' reason 'None'
Nov 10 16:11:42 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 16:11:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.mount [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Initialising _HostMountState generation 0 {{(pid=75102) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 10 16:11:49 user nova-compute[75102]: INFO nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt host capabilities <capabilities>
Nov 10 16:11:49 user nova-compute[75102]:   <host>
Nov 10 16:11:49 user nova-compute[75102]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 10 16:11:49 user nova-compute[75102]:     <cpu>
Nov 10 16:11:49 user nova-compute[75102]:       <arch>x86_64</arch>
Nov 10 16:11:49 user nova-compute[75102]:       <model>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <vendor>Intel</vendor>
Nov 10 16:11:49 user nova-compute[75102]:       <microcode version='1070'/>
Nov 10 16:11:49 user nova-compute[75102]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 10 16:11:49 user nova-compute[75102]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='ss'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='vmx'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='pcid'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='osxsave'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='hypervisor'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='arat'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='tsc_adjust'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='md-clear'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='arch-capabilities'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='invtsc'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='rsba'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature name='skip-l1dfl-vmentry'/>
Nov 10 16:11:49 user nova-compute[75102]:       <pages unit='KiB' size='4'/>
Nov 10 16:11:49 user nova-compute[75102]:       <pages unit='KiB' size='2048'/>
Nov 10 16:11:49 user nova-compute[75102]:     </cpu>
Nov 10 16:11:49 user nova-compute[75102]:     <power_management>
Nov 10 16:11:49 user nova-compute[75102]:       <suspend_mem/>
Nov 10 16:11:49 user nova-compute[75102]:       <suspend_disk/>
Nov 10 16:11:49 user nova-compute[75102]:       <suspend_hybrid/>
Nov 10 16:11:49 user nova-compute[75102]:     </power_management>
Nov 10 16:11:49 user nova-compute[75102]:     <iommu support='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     <migration_features>
Nov 10 16:11:49 user nova-compute[75102]:       <live/>
Nov 10 16:11:49 user nova-compute[75102]:       <uri_transports>
Nov 10 16:11:49 user nova-compute[75102]:         <uri_transport>tcp</uri_transport>
Nov 10 16:11:49 user nova-compute[75102]:         <uri_transport>rdma</uri_transport>
Nov 10 16:11:49 user nova-compute[75102]:       </uri_transports>
Nov 10 16:11:49 user nova-compute[75102]:     </migration_features>
Nov 10 16:11:49 user nova-compute[75102]:     <topology>
Nov 10 16:11:49 user nova-compute[75102]:       <cells num='2'>
Nov 10 16:11:49 user nova-compute[75102]:         <cell id='0'>
Nov 10 16:11:49 user nova-compute[75102]:           <memory unit='KiB'>8189224</memory>
Nov 10 16:11:49 user nova-compute[75102]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 10 16:11:49 user nova-compute[75102]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 16:11:49 user nova-compute[75102]:           <distances>
Nov 10 16:11:49 user nova-compute[75102]:             <sibling id='0' value='10'/>
Nov 10 16:11:49 user nova-compute[75102]:             <sibling id='1' value='20'/>
Nov 10 16:11:49 user nova-compute[75102]:           </distances>
Nov 10 16:11:49 user nova-compute[75102]:           <cpus num='6'>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 10 16:11:49 user nova-compute[75102]:           </cpus>
Nov 10 16:11:49 user nova-compute[75102]:         </cell>
Nov 10 16:11:49 user nova-compute[75102]:         <cell id='1'>
Nov 10 16:11:49 user nova-compute[75102]:           <memory unit='KiB'>8206460</memory>
Nov 10 16:11:49 user nova-compute[75102]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 10 16:11:49 user nova-compute[75102]:           <pages unit='KiB' size='2048'>0</pages>
Nov 10 16:11:49 user nova-compute[75102]:           <distances>
Nov 10 16:11:49 user nova-compute[75102]:             <sibling id='0' value='20'/>
Nov 10 16:11:49 user nova-compute[75102]:             <sibling id='1' value='10'/>
Nov 10 16:11:49 user nova-compute[75102]:           </distances>
Nov 10 16:11:49 user nova-compute[75102]:           <cpus num='6'>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 10 16:11:49 user nova-compute[75102]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 10 16:11:49 user nova-compute[75102]:           </cpus>
Nov 10 16:11:49 user nova-compute[75102]:         </cell>
Nov 10 16:11:49 user nova-compute[75102]:       </cells>
Nov 10 16:11:49 user nova-compute[75102]:     </topology>
Nov 10 16:11:49 user nova-compute[75102]:     <cache>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 10 16:11:49 user nova-compute[75102]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 10 16:11:49 user nova-compute[75102]:     </cache>
Nov 10 16:11:49 user nova-compute[75102]:     <secmodel>
Nov 10 16:11:49 user nova-compute[75102]:       <model>apparmor</model>
Nov 10 16:11:49 user nova-compute[75102]:       <doi>0</doi>
Nov 10 16:11:49 user nova-compute[75102]:     </secmodel>
Nov 10 16:11:49 user nova-compute[75102]:     <secmodel>
Nov 10 16:11:49 user nova-compute[75102]:       <model>dac</model>
Nov 10 16:11:49 user nova-compute[75102]:       <doi>0</doi>
Nov 10 16:11:49 user nova-compute[75102]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 10 16:11:49 user nova-compute[75102]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 10 16:11:49 user nova-compute[75102]:     </secmodel>
Nov 10 16:11:49 user nova-compute[75102]:   </host>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='alpha'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>clipper</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='armv6l'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>spitz</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>nuri</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>kzm</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sx1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>z2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>tosa</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>n810</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>n800</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>terrier</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>midway</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>microbit</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>verdex</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>highbank</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>akita</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>connex</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>collie</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='armv7l'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>spitz</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>nuri</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>kzm</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sx1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>z2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>tosa</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>n810</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>n800</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>terrier</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>midway</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>microbit</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>verdex</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>highbank</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>akita</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>connex</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>collie</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='aarch64'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>integratorcp</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>borzoi</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>spitz</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>nuri</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>musca-b1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>versatileab</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>kzm</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>musca-a</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>smdkc210</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sx1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>z2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>tosa</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>sabrelite</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>realview-eb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>n810</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>n800</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>versatilepb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>terrier</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mainstone</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>midway</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>musicpal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>microbit</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>cubieboard</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>verdex</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>netduino2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>raspi3b</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>raspi2b</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>cheetah</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>highbank</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>akita</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>connex</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>collie</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>raspi0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <acpi default='on' toggle='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='cris'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='i686'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>isapc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>microvm</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='kvm'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <pae/>
Nov 10 16:11:49 user nova-compute[75102]:       <nonpae/>
Nov 10 16:11:49 user nova-compute[75102]:       <acpi default='on' toggle='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:       <apic default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='m68k'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>an5206</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>q800</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>next-cube</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='microblaze'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='microblazeel'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='mips'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='16'>malta</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='mipsel'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='16'>malta</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='mips64'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='16'>malta</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>pica61</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>magnum</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='mips64el'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='16'>malta</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mipssim</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>pica61</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>magnum</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='16'>boston</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='ppc'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mac99</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>40p</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>taihu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='ppc64'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>taihu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>40p</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mac99</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='ppc64le'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2048'>powernv9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>taihu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2048'>powernv10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>ppce500</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>40p</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>pegasos2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>bamboo</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>g3beige</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>mac99</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sam460ex</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>ref405ep</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2048'>powernv8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='riscv32'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='8'>spike</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>opentitan</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='8'>virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='riscv64'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='8'>spike</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='5'>sifive_u</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>shakti_c</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sifive_e</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='8'>virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='s390x'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='sh4'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>shix</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>r2d</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='sh4eb'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>shix</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>r2d</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='sparc'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>SS-5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>SS-20</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>LX</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>SS-4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>SS-10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>Voyager</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='sparc64'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sun4u</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>niagara</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>sun4v</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='x86_64'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>64</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>x-remote</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='1'>isapc</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>microvm</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='kvm'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <acpi default='on' toggle='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:       <apic default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='xtensa'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>sim</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>kc705</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>ml605</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>lx200</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>lx60</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]:   <guest>
Nov 10 16:11:49 user nova-compute[75102]:     <os_type>hvm</os_type>
Nov 10 16:11:49 user nova-compute[75102]:     <arch name='xtensaeb'>
Nov 10 16:11:49 user nova-compute[75102]:       <wordsize>32</wordsize>
Nov 10 16:11:49 user nova-compute[75102]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='4'>sim</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>kc705</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>ml605</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>virt</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>lx200</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>lx60</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 10 16:11:49 user nova-compute[75102]:       <domain type='qemu'/>
Nov 10 16:11:49 user nova-compute[75102]:     </arch>
Nov 10 16:11:49 user nova-compute[75102]:     <features>
Nov 10 16:11:49 user nova-compute[75102]:       <cpuselection/>
Nov 10 16:11:49 user nova-compute[75102]:       <deviceboot/>
Nov 10 16:11:49 user nova-compute[75102]:       <disksnapshot default='on' toggle='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     </features>
Nov 10 16:11:49 user nova-compute[75102]:   </guest>
Nov 10 16:11:49 user nova-compute[75102]: </capabilities>
Nov 10 16:11:49 user nova-compute[75102]: 
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for i686 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 10 16:11:49 user nova-compute[75102]: <domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 16:11:49 user nova-compute[75102]:   <domain>kvm</domain>
Nov 10 16:11:49 user nova-compute[75102]:   <machine>pc-q35-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:   <arch>i686</arch>
Nov 10 16:11:49 user nova-compute[75102]:   <vcpu max='288'/>
Nov 10 16:11:49 user nova-compute[75102]:   <iothreads supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:   <os supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='firmware'/>
Nov 10 16:11:49 user nova-compute[75102]:     <loader supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>rom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pflash</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='readonly'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='secure'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </loader>
Nov 10 16:11:49 user nova-compute[75102]:   </os>
Nov 10 16:11:49 user nova-compute[75102]:   <cpu>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-passthrough' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='hostPassthroughMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='maximum' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='maximumMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-model' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <vendor>Intel</vendor>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ss'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='vmx'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pcid'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='hypervisor'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arat'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='umip'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='md-clear'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibpb'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibrs'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='erms'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='lm'/>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='custom' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>qemu64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>qemu32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>phenom</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>n270</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>kvm64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>coreduo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>core2duo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>athlon</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Westmere</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Snowridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Penryn</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G5</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G4</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G1</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Nehalem</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Rome</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Milan</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Dhyana</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cooperlake</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Conroe</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>486</model>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:   </cpu>
Nov 10 16:11:49 user nova-compute[75102]:   <memoryBacking supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='sourceType'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>file</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>anonymous</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>memfd</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:   </memoryBacking>
Nov 10 16:11:49 user nova-compute[75102]:   <devices>
Nov 10 16:11:49 user nova-compute[75102]:     <disk supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='diskDevice'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>disk</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cdrom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>floppy</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>lun</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='bus'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>fdc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sata</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </disk>
Nov 10 16:11:49 user nova-compute[75102]:     <graphics supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sdl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vnc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>spice</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egl-headless</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </graphics>
Nov 10 16:11:49 user nova-compute[75102]:     <video supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='modelType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cirrus</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vmvga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>qxl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>none</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>bochs</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ramfb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </video>
Nov 10 16:11:49 user nova-compute[75102]:     <hostdev supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='mode'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>subsystem</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='startupPolicy'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>default</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>mandatory</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>requisite</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>optional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='subsysType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pci</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='capsType'/>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='pciBackend'/>
Nov 10 16:11:49 user nova-compute[75102]:     </hostdev>
Nov 10 16:11:49 user nova-compute[75102]:     <rng supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>random</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egd</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>builtin</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </rng>
Nov 10 16:11:49 user nova-compute[75102]:     <filesystem supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='driverType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>path</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>handle</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtiofs</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </filesystem>
Nov 10 16:11:49 user nova-compute[75102]:     <tpm supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-tis</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-crb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>passthrough</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>emulator</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </tpm>
Nov 10 16:11:49 user nova-compute[75102]:   </devices>
Nov 10 16:11:49 user nova-compute[75102]:   <features>
Nov 10 16:11:49 user nova-compute[75102]:     <gic supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     <vmcoreinfo supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <genid supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backingStoreInput supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backup supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <sev supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:   </features>
Nov 10 16:11:49 user nova-compute[75102]: </domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:  {{(pid=75102) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 10 16:11:49 user nova-compute[75102]: <domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 16:11:49 user nova-compute[75102]:   <domain>kvm</domain>
Nov 10 16:11:49 user nova-compute[75102]:   <machine>pc-i440fx-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:   <arch>i686</arch>
Nov 10 16:11:49 user nova-compute[75102]:   <vcpu max='255'/>
Nov 10 16:11:49 user nova-compute[75102]:   <iothreads supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:   <os supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='firmware'/>
Nov 10 16:11:49 user nova-compute[75102]:     <loader supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>rom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pflash</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='readonly'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='secure'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </loader>
Nov 10 16:11:49 user nova-compute[75102]:   </os>
Nov 10 16:11:49 user nova-compute[75102]:   <cpu>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-passthrough' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='hostPassthroughMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='maximum' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='maximumMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-model' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <vendor>Intel</vendor>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ss'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='vmx'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pcid'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='hypervisor'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arat'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='umip'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='md-clear'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibpb'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibrs'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='erms'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='lm'/>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='custom' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>qemu64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>qemu32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>phenom</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>n270</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>kvm64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>coreduo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>core2duo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>athlon</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Westmere</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Snowridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Penryn</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G5</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G4</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G1</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Nehalem</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Rome</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Milan</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Dhyana</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cooperlake</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Conroe</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>486</model>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:   </cpu>
Nov 10 16:11:49 user nova-compute[75102]:   <memoryBacking supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='sourceType'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>file</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>anonymous</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>memfd</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:   </memoryBacking>
Nov 10 16:11:49 user nova-compute[75102]:   <devices>
Nov 10 16:11:49 user nova-compute[75102]:     <disk supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='diskDevice'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>disk</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cdrom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>floppy</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>lun</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='bus'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ide</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>fdc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sata</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </disk>
Nov 10 16:11:49 user nova-compute[75102]:     <graphics supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sdl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vnc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>spice</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egl-headless</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </graphics>
Nov 10 16:11:49 user nova-compute[75102]:     <video supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='modelType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cirrus</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vmvga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>qxl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>none</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>bochs</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ramfb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </video>
Nov 10 16:11:49 user nova-compute[75102]:     <hostdev supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='mode'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>subsystem</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='startupPolicy'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>default</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>mandatory</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>requisite</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>optional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='subsysType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pci</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='capsType'/>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='pciBackend'/>
Nov 10 16:11:49 user nova-compute[75102]:     </hostdev>
Nov 10 16:11:49 user nova-compute[75102]:     <rng supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>random</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egd</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>builtin</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </rng>
Nov 10 16:11:49 user nova-compute[75102]:     <filesystem supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='driverType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>path</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>handle</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtiofs</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </filesystem>
Nov 10 16:11:49 user nova-compute[75102]:     <tpm supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-tis</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-crb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>passthrough</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>emulator</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </tpm>
Nov 10 16:11:49 user nova-compute[75102]:   </devices>
Nov 10 16:11:49 user nova-compute[75102]:   <features>
Nov 10 16:11:49 user nova-compute[75102]:     <gic supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     <vmcoreinfo supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <genid supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backingStoreInput supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backup supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <sev supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:   </features>
Nov 10 16:11:49 user nova-compute[75102]: </domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:  {{(pid=75102) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 10 16:11:49 user nova-compute[75102]: <domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 16:11:49 user nova-compute[75102]:   <domain>kvm</domain>
Nov 10 16:11:49 user nova-compute[75102]:   <machine>pc-q35-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:   <arch>i686</arch>
Nov 10 16:11:49 user nova-compute[75102]:   <vcpu max='288'/>
Nov 10 16:11:49 user nova-compute[75102]:   <iothreads supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:   <os supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='firmware'/>
Nov 10 16:11:49 user nova-compute[75102]:     <loader supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>rom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pflash</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='readonly'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='secure'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </loader>
Nov 10 16:11:49 user nova-compute[75102]:   </os>
Nov 10 16:11:49 user nova-compute[75102]:   <cpu>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-passthrough' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='hostPassthroughMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='maximum' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='maximumMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-model' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <vendor>Intel</vendor>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ss'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='vmx'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pcid'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='hypervisor'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arat'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='umip'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='md-clear'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibpb'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibrs'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='erms'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='lm'/>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='custom' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>qemu64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>qemu32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>phenom</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>n270</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>kvm64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>coreduo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>core2duo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>athlon</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Westmere</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Snowridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Penryn</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G5</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G4</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G1</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Nehalem</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Rome</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Milan</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Dhyana</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cooperlake</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Conroe</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>486</model>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:   </cpu>
Nov 10 16:11:49 user nova-compute[75102]:   <memoryBacking supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='sourceType'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>file</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>anonymous</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>memfd</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:   </memoryBacking>
Nov 10 16:11:49 user nova-compute[75102]:   <devices>
Nov 10 16:11:49 user nova-compute[75102]:     <disk supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='diskDevice'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>disk</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cdrom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>floppy</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>lun</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='bus'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>fdc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sata</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </disk>
Nov 10 16:11:49 user nova-compute[75102]:     <graphics supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sdl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vnc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>spice</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egl-headless</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </graphics>
Nov 10 16:11:49 user nova-compute[75102]:     <video supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='modelType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cirrus</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vmvga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>qxl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>none</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>bochs</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ramfb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </video>
Nov 10 16:11:49 user nova-compute[75102]:     <hostdev supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='mode'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>subsystem</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='startupPolicy'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>default</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>mandatory</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>requisite</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>optional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='subsysType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pci</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='capsType'/>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='pciBackend'/>
Nov 10 16:11:49 user nova-compute[75102]:     </hostdev>
Nov 10 16:11:49 user nova-compute[75102]:     <rng supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>random</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egd</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>builtin</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </rng>
Nov 10 16:11:49 user nova-compute[75102]:     <filesystem supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='driverType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>path</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>handle</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtiofs</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </filesystem>
Nov 10 16:11:49 user nova-compute[75102]:     <tpm supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-tis</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-crb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>passthrough</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>emulator</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </tpm>
Nov 10 16:11:49 user nova-compute[75102]:   </devices>
Nov 10 16:11:49 user nova-compute[75102]:   <features>
Nov 10 16:11:49 user nova-compute[75102]:     <gic supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     <vmcoreinfo supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <genid supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backingStoreInput supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backup supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <sev supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:   </features>
Nov 10 16:11:49 user nova-compute[75102]: </domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:  {{(pid=75102) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 10 16:11:49 user nova-compute[75102]: <domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:   <path>/usr/bin/qemu-system-i386</path>
Nov 10 16:11:49 user nova-compute[75102]:   <domain>kvm</domain>
Nov 10 16:11:49 user nova-compute[75102]:   <machine>pc-i440fx-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:   <arch>i686</arch>
Nov 10 16:11:49 user nova-compute[75102]:   <vcpu max='255'/>
Nov 10 16:11:49 user nova-compute[75102]:   <iothreads supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:   <os supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='firmware'/>
Nov 10 16:11:49 user nova-compute[75102]:     <loader supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>rom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pflash</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='readonly'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='secure'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </loader>
Nov 10 16:11:49 user nova-compute[75102]:   </os>
Nov 10 16:11:49 user nova-compute[75102]:   <cpu>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-passthrough' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='hostPassthroughMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='maximum' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='maximumMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-model' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <vendor>Intel</vendor>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ss'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='vmx'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pcid'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='hypervisor'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arat'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='umip'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='md-clear'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibpb'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibrs'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='erms'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='lm'/>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='custom' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>qemu64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>qemu32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>phenom</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>n270</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>kvm64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>coreduo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>core2duo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>athlon</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Westmere-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Westmere</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Snowridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Penryn</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G5</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G4</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G1</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Nehalem-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Nehalem</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Rome</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Milan</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Dhyana</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cooperlake</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Conroe</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>486</model>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:   </cpu>
Nov 10 16:11:49 user nova-compute[75102]:   <memoryBacking supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='sourceType'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>file</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>anonymous</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>memfd</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:   </memoryBacking>
Nov 10 16:11:49 user nova-compute[75102]:   <devices>
Nov 10 16:11:49 user nova-compute[75102]:     <disk supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='diskDevice'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>disk</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cdrom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>floppy</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>lun</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='bus'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ide</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>fdc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sata</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </disk>
Nov 10 16:11:49 user nova-compute[75102]:     <graphics supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sdl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vnc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>spice</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egl-headless</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </graphics>
Nov 10 16:11:49 user nova-compute[75102]:     <video supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='modelType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cirrus</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vmvga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>qxl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>none</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>bochs</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ramfb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </video>
Nov 10 16:11:49 user nova-compute[75102]:     <hostdev supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='mode'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>subsystem</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='startupPolicy'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>default</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>mandatory</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>requisite</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>optional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='subsysType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pci</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='capsType'/>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='pciBackend'/>
Nov 10 16:11:49 user nova-compute[75102]:     </hostdev>
Nov 10 16:11:49 user nova-compute[75102]:     <rng supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>random</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egd</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>builtin</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </rng>
Nov 10 16:11:49 user nova-compute[75102]:     <filesystem supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='driverType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>path</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>handle</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtiofs</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </filesystem>
Nov 10 16:11:49 user nova-compute[75102]:     <tpm supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-tis</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-crb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>passthrough</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>emulator</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </tpm>
Nov 10 16:11:49 user nova-compute[75102]:   </devices>
Nov 10 16:11:49 user nova-compute[75102]:   <features>
Nov 10 16:11:49 user nova-compute[75102]:     <gic supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     <vmcoreinfo supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <genid supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backingStoreInput supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backup supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <sev supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:   </features>
Nov 10 16:11:49 user nova-compute[75102]: </domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:  {{(pid=75102) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu-q35', 'ubuntu', 'q35', 'pc'} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 10 16:11:49 user nova-compute[75102]: <domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 16:11:49 user nova-compute[75102]:   <domain>kvm</domain>
Nov 10 16:11:49 user nova-compute[75102]:   <machine>pc-q35-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:   <arch>x86_64</arch>
Nov 10 16:11:49 user nova-compute[75102]:   <vcpu max='288'/>
Nov 10 16:11:49 user nova-compute[75102]:   <iothreads supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:   <os supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='firmware'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>efi</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:     <loader supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>rom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pflash</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='readonly'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='secure'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </loader>
Nov 10 16:11:49 user nova-compute[75102]:   </os>
Nov 10 16:11:49 user nova-compute[75102]:   <cpu>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-passthrough' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='hostPassthroughMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='maximum' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='maximumMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-model' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <vendor>Intel</vendor>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ss'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='vmx'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pcid'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='hypervisor'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arat'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='umip'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='md-clear'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='invtsc'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibpb'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibrs'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='rsba'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='erms'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='custom' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>qemu64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>qemu32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>phenom</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>n270</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>coreduo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>core2duo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>athlon</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Westmere</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Snowridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Penryn</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G5</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G4</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Opteron_G1</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Nehalem</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Rome</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Milan</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Dhyana</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cooperlake</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Conroe</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>486</model>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:   </cpu>
Nov 10 16:11:49 user nova-compute[75102]:   <memoryBacking supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='sourceType'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>file</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>anonymous</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>memfd</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:   </memoryBacking>
Nov 10 16:11:49 user nova-compute[75102]:   <devices>
Nov 10 16:11:49 user nova-compute[75102]:     <disk supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='diskDevice'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>disk</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cdrom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>floppy</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>lun</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='bus'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>fdc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sata</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </disk>
Nov 10 16:11:49 user nova-compute[75102]:     <graphics supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sdl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vnc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>spice</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egl-headless</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </graphics>
Nov 10 16:11:49 user nova-compute[75102]:     <video supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='modelType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cirrus</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vmvga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>qxl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>none</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>bochs</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ramfb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </video>
Nov 10 16:11:49 user nova-compute[75102]:     <hostdev supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='mode'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>subsystem</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='startupPolicy'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>default</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>mandatory</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>requisite</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>optional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='subsysType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pci</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='capsType'/>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='pciBackend'/>
Nov 10 16:11:49 user nova-compute[75102]:     </hostdev>
Nov 10 16:11:49 user nova-compute[75102]:     <rng supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>random</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egd</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>builtin</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </rng>
Nov 10 16:11:49 user nova-compute[75102]:     <filesystem supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='driverType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>path</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>handle</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtiofs</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </filesystem>
Nov 10 16:11:49 user nova-compute[75102]:     <tpm supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-tis</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-crb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>passthrough</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>emulator</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </tpm>
Nov 10 16:11:49 user nova-compute[75102]:   </devices>
Nov 10 16:11:49 user nova-compute[75102]:   <features>
Nov 10 16:11:49 user nova-compute[75102]:     <gic supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     <vmcoreinfo supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <genid supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backingStoreInput supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backup supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <sev supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:   </features>
Nov 10 16:11:49 user nova-compute[75102]: </domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:  {{(pid=75102) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 10 16:11:49 user nova-compute[75102]: <domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 16:11:49 user nova-compute[75102]:   <domain>kvm</domain>
Nov 10 16:11:49 user nova-compute[75102]:   <machine>pc-i440fx-jammy</machine>
Nov 10 16:11:49 user nova-compute[75102]:   <arch>x86_64</arch>
Nov 10 16:11:49 user nova-compute[75102]:   <vcpu max='255'/>
Nov 10 16:11:49 user nova-compute[75102]:   <iothreads supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:   <os supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='firmware'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>efi</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:     <loader supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>rom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pflash</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='readonly'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='secure'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </loader>
Nov 10 16:11:49 user nova-compute[75102]:   </os>
Nov 10 16:11:49 user nova-compute[75102]:   <cpu>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-passthrough' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='hostPassthroughMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='maximum' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='maximumMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-model' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <vendor>Intel</vendor>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ss'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='vmx'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pcid'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='hypervisor'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arat'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='umip'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='md-clear'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='invtsc'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibpb'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibrs'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='rsba'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='erms'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='custom' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>qemu64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>qemu32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>phenom</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>n270</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>coreduo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>core2duo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>athlon</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Westmere</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Snowridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Penryn</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G5</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G4</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Opteron_G1</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Nehalem</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Rome</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Milan</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Dhyana</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cooperlake</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Conroe</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>486</model>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:   </cpu>
Nov 10 16:11:49 user nova-compute[75102]:   <memoryBacking supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='sourceType'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>file</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>anonymous</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>memfd</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:   </memoryBacking>
Nov 10 16:11:49 user nova-compute[75102]:   <devices>
Nov 10 16:11:49 user nova-compute[75102]:     <disk supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='diskDevice'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>disk</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cdrom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>floppy</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>lun</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='bus'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ide</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>fdc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sata</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </disk>
Nov 10 16:11:49 user nova-compute[75102]:     <graphics supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sdl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vnc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>spice</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egl-headless</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </graphics>
Nov 10 16:11:49 user nova-compute[75102]:     <video supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='modelType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cirrus</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vmvga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>qxl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>none</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>bochs</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ramfb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </video>
Nov 10 16:11:49 user nova-compute[75102]:     <hostdev supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='mode'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>subsystem</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='startupPolicy'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>default</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>mandatory</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>requisite</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>optional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='subsysType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pci</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='capsType'/>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='pciBackend'/>
Nov 10 16:11:49 user nova-compute[75102]:     </hostdev>
Nov 10 16:11:49 user nova-compute[75102]:     <rng supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>random</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egd</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>builtin</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </rng>
Nov 10 16:11:49 user nova-compute[75102]:     <filesystem supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='driverType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>path</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>handle</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtiofs</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </filesystem>
Nov 10 16:11:49 user nova-compute[75102]:     <tpm supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-tis</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-crb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>passthrough</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>emulator</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </tpm>
Nov 10 16:11:49 user nova-compute[75102]:   </devices>
Nov 10 16:11:49 user nova-compute[75102]:   <features>
Nov 10 16:11:49 user nova-compute[75102]:     <gic supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     <vmcoreinfo supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <genid supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backingStoreInput supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backup supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <sev supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:   </features>
Nov 10 16:11:49 user nova-compute[75102]: </domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:  {{(pid=75102) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 10 16:11:49 user nova-compute[75102]: <domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 16:11:49 user nova-compute[75102]:   <domain>kvm</domain>
Nov 10 16:11:49 user nova-compute[75102]:   <machine>pc-q35-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:   <arch>x86_64</arch>
Nov 10 16:11:49 user nova-compute[75102]:   <vcpu max='288'/>
Nov 10 16:11:49 user nova-compute[75102]:   <iothreads supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:   <os supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='firmware'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>efi</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:     <loader supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>rom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pflash</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='readonly'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='secure'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </loader>
Nov 10 16:11:49 user nova-compute[75102]:   </os>
Nov 10 16:11:49 user nova-compute[75102]:   <cpu>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-passthrough' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='hostPassthroughMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='maximum' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='maximumMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-model' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <vendor>Intel</vendor>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ss'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='vmx'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pcid'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='hypervisor'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arat'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='umip'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='md-clear'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='invtsc'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibpb'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibrs'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='rsba'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='erms'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='custom' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>qemu64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>qemu32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>phenom</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>n270</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>coreduo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>core2duo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>athlon</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Westmere</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Snowridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Penryn</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G5</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G4</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Opteron_G1</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Nehalem</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Rome</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Milan</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Dhyana</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cooperlake</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Conroe</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>486</model>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:   </cpu>
Nov 10 16:11:49 user nova-compute[75102]:   <memoryBacking supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='sourceType'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>file</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>anonymous</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>memfd</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:   </memoryBacking>
Nov 10 16:11:49 user nova-compute[75102]:   <devices>
Nov 10 16:11:49 user nova-compute[75102]:     <disk supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='diskDevice'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>disk</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cdrom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>floppy</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>lun</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='bus'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>fdc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sata</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </disk>
Nov 10 16:11:49 user nova-compute[75102]:     <graphics supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sdl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vnc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>spice</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egl-headless</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </graphics>
Nov 10 16:11:49 user nova-compute[75102]:     <video supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='modelType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cirrus</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vmvga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>qxl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>none</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>bochs</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ramfb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </video>
Nov 10 16:11:49 user nova-compute[75102]:     <hostdev supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='mode'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>subsystem</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='startupPolicy'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>default</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>mandatory</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>requisite</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>optional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='subsysType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pci</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='capsType'/>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='pciBackend'/>
Nov 10 16:11:49 user nova-compute[75102]:     </hostdev>
Nov 10 16:11:49 user nova-compute[75102]:     <rng supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>random</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egd</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>builtin</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </rng>
Nov 10 16:11:49 user nova-compute[75102]:     <filesystem supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='driverType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>path</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>handle</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtiofs</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </filesystem>
Nov 10 16:11:49 user nova-compute[75102]:     <tpm supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-tis</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-crb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>passthrough</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>emulator</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </tpm>
Nov 10 16:11:49 user nova-compute[75102]:   </devices>
Nov 10 16:11:49 user nova-compute[75102]:   <features>
Nov 10 16:11:49 user nova-compute[75102]:     <gic supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     <vmcoreinfo supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <genid supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backingStoreInput supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backup supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <sev supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:   </features>
Nov 10 16:11:49 user nova-compute[75102]: </domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:  {{(pid=75102) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 10 16:11:49 user nova-compute[75102]: <domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 10 16:11:49 user nova-compute[75102]:   <domain>kvm</domain>
Nov 10 16:11:49 user nova-compute[75102]:   <machine>pc-i440fx-6.2</machine>
Nov 10 16:11:49 user nova-compute[75102]:   <arch>x86_64</arch>
Nov 10 16:11:49 user nova-compute[75102]:   <vcpu max='255'/>
Nov 10 16:11:49 user nova-compute[75102]:   <iothreads supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:   <os supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='firmware'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>efi</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:     <loader supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>rom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pflash</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='readonly'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>yes</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='secure'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>no</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </loader>
Nov 10 16:11:49 user nova-compute[75102]:   </os>
Nov 10 16:11:49 user nova-compute[75102]:   <cpu>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-passthrough' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='hostPassthroughMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='maximum' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='maximumMigratable'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>on</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>off</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='host-model' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <vendor>Intel</vendor>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ss'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='vmx'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pcid'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='hypervisor'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arat'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='tsc_adjust'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='umip'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='md-clear'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='arch-capabilities'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='invtsc'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibpb'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='ibrs'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-stibp'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='amd-ssbd'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='rsba'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='require' name='pschange-mc-no'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='erms'/>
Nov 10 16:11:49 user nova-compute[75102]:       <feature policy='disable' name='xsaveopt'/>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:     <mode name='custom' supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>qemu64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>qemu32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>phenom</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>pentium</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>n270</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm64</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>kvm32</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>coreduo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>core2duo</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>athlon</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Westmere-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Westmere</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Snowridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Skylake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>SandyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Penryn</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G5</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G4</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G3</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Opteron_G2</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Opteron_G1</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Nehalem</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>IvyBridge</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Icelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Haswell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Rome</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-Milan</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC-IBPB</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>EPYC</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Dhyana</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cooperlake</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>Conroe</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Cascadelake-Server</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-noTSX</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell-IBRS</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='no'>Broadwell</model>
Nov 10 16:11:49 user nova-compute[75102]:       <model usable='yes'>486</model>
Nov 10 16:11:49 user nova-compute[75102]:     </mode>
Nov 10 16:11:49 user nova-compute[75102]:   </cpu>
Nov 10 16:11:49 user nova-compute[75102]:   <memoryBacking supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:     <enum name='sourceType'>
Nov 10 16:11:49 user nova-compute[75102]:       <value>file</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>anonymous</value>
Nov 10 16:11:49 user nova-compute[75102]:       <value>memfd</value>
Nov 10 16:11:49 user nova-compute[75102]:     </enum>
Nov 10 16:11:49 user nova-compute[75102]:   </memoryBacking>
Nov 10 16:11:49 user nova-compute[75102]:   <devices>
Nov 10 16:11:49 user nova-compute[75102]:     <disk supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='diskDevice'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>disk</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cdrom</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>floppy</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>lun</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='bus'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ide</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>fdc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sata</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </disk>
Nov 10 16:11:49 user nova-compute[75102]:     <graphics supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='type'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>sdl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vnc</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>spice</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egl-headless</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </graphics>
Nov 10 16:11:49 user nova-compute[75102]:     <video supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='modelType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>cirrus</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>vmvga</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>qxl</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>none</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>bochs</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>ramfb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </video>
Nov 10 16:11:49 user nova-compute[75102]:     <hostdev supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='mode'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>subsystem</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='startupPolicy'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>default</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>mandatory</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>requisite</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>optional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='subsysType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>usb</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>pci</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>scsi</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='capsType'/>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='pciBackend'/>
Nov 10 16:11:49 user nova-compute[75102]:     </hostdev>
Nov 10 16:11:49 user nova-compute[75102]:     <rng supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtio-non-transitional</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>random</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>egd</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>builtin</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </rng>
Nov 10 16:11:49 user nova-compute[75102]:     <filesystem supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='driverType'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>path</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>handle</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>virtiofs</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </filesystem>
Nov 10 16:11:49 user nova-compute[75102]:     <tpm supported='yes'>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='model'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-tis</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>tpm-crb</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:       <enum name='backendModel'>
Nov 10 16:11:49 user nova-compute[75102]:         <value>passthrough</value>
Nov 10 16:11:49 user nova-compute[75102]:         <value>emulator</value>
Nov 10 16:11:49 user nova-compute[75102]:       </enum>
Nov 10 16:11:49 user nova-compute[75102]:     </tpm>
Nov 10 16:11:49 user nova-compute[75102]:   </devices>
Nov 10 16:11:49 user nova-compute[75102]:   <features>
Nov 10 16:11:49 user nova-compute[75102]:     <gic supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:     <vmcoreinfo supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <genid supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backingStoreInput supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <backup supported='yes'/>
Nov 10 16:11:49 user nova-compute[75102]:     <sev supported='no'/>
Nov 10 16:11:49 user nova-compute[75102]:   </features>
Nov 10 16:11:49 user nova-compute[75102]: </domainCapabilities>
Nov 10 16:11:49 user nova-compute[75102]:  {{(pid=75102) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75102) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75102) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Checking secure boot support for host arch (x86_64) {{(pid=75102) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 10 16:11:49 user nova-compute[75102]: INFO nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Secure Boot support detected
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] cpu compare xml: <cpu match="exact">
Nov 10 16:11:49 user nova-compute[75102]:   <model>Nehalem</model>
Nov 10 16:11:49 user nova-compute[75102]: </cpu>
Nov 10 16:11:49 user nova-compute[75102]:  {{(pid=75102) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 10 16:11:49 user nova-compute[75102]: INFO nova.virt.node [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Generated node identity fe24d663-5905-4042-a478-befa03efc244
Nov 10 16:11:49 user nova-compute[75102]: INFO nova.virt.node [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Wrote node identity fe24d663-5905-4042-a478-befa03efc244 to /opt/stack/data/nova/compute_id
Nov 10 16:11:49 user nova-compute[75102]: WARNING nova.compute.manager [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Compute nodes ['fe24d663-5905-4042-a478-befa03efc244'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 10 16:11:49 user nova-compute[75102]: INFO nova.compute.manager [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 10 16:11:49 user nova-compute[75102]: WARNING nova.compute.manager [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 10 16:11:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:11:49 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:11:49 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Hypervisor/Node resource view: name=user free_ram=11032MB free_disk=26.21249771118164GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:11:49 user nova-compute[75102]: WARNING nova.compute.resource_tracker [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] No compute node record for user:fe24d663-5905-4042-a478-befa03efc244: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host fe24d663-5905-4042-a478-befa03efc244 could not be found.
Nov 10 16:11:49 user nova-compute[75102]: INFO nova.compute.resource_tracker [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Compute node record created for user:user with uuid: fe24d663-5905-4042-a478-befa03efc244
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:11:49 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:11:50 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] [req-17963ecb-be30-470d-92da-510736c0cfef] Created resource provider record via placement API for resource provider with UUID fe24d663-5905-4042-a478-befa03efc244 and name user.
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75102) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 10 16:11:50 user nova-compute[75102]: INFO nova.virt.libvirt.host [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] kernel doesn't support AMD SEV
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Libvirt baseline CPU <cpu>
Nov 10 16:11:50 user nova-compute[75102]:   <arch>x86_64</arch>
Nov 10 16:11:50 user nova-compute[75102]:   <model>Nehalem</model>
Nov 10 16:11:50 user nova-compute[75102]:   <vendor>Intel</vendor>
Nov 10 16:11:50 user nova-compute[75102]:   <topology sockets="6" cores="1" threads="1"/>
Nov 10 16:11:50 user nova-compute[75102]: </cpu>
Nov 10 16:11:50 user nova-compute[75102]:  {{(pid=75102) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Updated inventory for provider fe24d663-5905-4042-a478-befa03efc244 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Updating resource provider fe24d663-5905-4042-a478-befa03efc244 generation from 0 to 1 during operation: update_inventory {{(pid=75102) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Updating resource provider fe24d663-5905-4042-a478-befa03efc244 generation from 1 to 2 during operation: update_traits {{(pid=75102) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.636s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.service [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Creating RPC server for service compute {{(pid=75102) start /opt/stack/nova/nova/service.py:182}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.service [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] Join ServiceGroup membership for this service compute {{(pid=75102) start /opt/stack/nova/nova/service.py:199}}
Nov 10 16:11:50 user nova-compute[75102]: DEBUG nova.servicegroup.drivers.db [None req-c8c57286-d5a6-4be8-a137-4279cd9db1fe None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75102) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:12:50 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:12:50 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=10412MB free_disk=26.1162109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:12:50 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:12:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:12:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:12:51 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:13:42 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:13:42 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=10373MB free_disk=26.180484771728516GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:13:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:13:43 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:43 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:13:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:14:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:14:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:14:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:14:43 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:14:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:14:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:14:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 16:14:43 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:14:44 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:14:44 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:14:44 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=10378MB free_disk=25.933101654052734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:14:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.133s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:14:45 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:43 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:43 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:15:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:15:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 16:15:43 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:15:44 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:15:44 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:15:44 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=9644MB free_disk=25.952510833740234GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:15:44 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:15:45 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:15:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:15:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:15:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:15:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:49 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:15:49 user nova-compute[75102]: INFO nova.compute.claims [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Claim successful on node user
Nov 10 16:15:49 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:15:49 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:15:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.303s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:15:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:15:50 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:15:50 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:15:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:15:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:15:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:15:50 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Creating image(s)
Nov 10 16:15:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "/opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "/opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "/opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:50 user nova-compute[75102]: DEBUG nova.policy [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2f59ff0fdd8a4b9e8ae6242cfffdc772', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4bdba856e084870ad806f7f7b807bef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb.part --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb.part --force-share --output=json" returned: 0 in 0.162s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG nova.virt.images [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] a26f5e2e-1666-4272-b064-065539894418 was qcow2, converting to raw {{(pid=75102) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb.part /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb.converted {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb.part /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb.converted" returned: 0 in 0.259s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb.converted --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.605s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:51 user nova-compute[75102]: INFO oslo.privsep.daemon [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpv53_vef2/privsep.sock']
Nov 10 16:15:51 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:15:51 user sudo[84353]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpv53_vef2/privsep.sock
Nov 10 16:15:51 user sudo[84353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 16:15:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:15:52 user nova-compute[75102]: INFO nova.compute.claims [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Claim successful on node user
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.392s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:15:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Successfully created port: 6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:15:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Creating image(s)
Nov 10 16:15:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "/opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "/opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "/opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:52 user nova-compute[75102]: DEBUG nova.policy [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3149d0620bf64829aa4eec99a2cddee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e926f56f914e7488a50f5bb78a33cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:15:53 user sudo[84353]: pam_unix(sudo:session): session closed for user root
Nov 10 16:15:53 user nova-compute[75102]: INFO oslo.privsep.daemon [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Spawned new privsep daemon via rootwrap
Nov 10 16:15:53 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 16:15:53 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 16:15:53 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 10 16:15:53 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84356
Nov 10 16:15:53 user nova-compute[75102]: WARNING oslo_privsep.priv_context [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] privsep daemon already running
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Successfully updated port: 6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.168s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "refresh_cache-e7db38aa-7e5d-4b9a-a7f4-362819172489" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquired lock "refresh_cache-e7db38aa-7e5d-4b9a-a7f4-362819172489" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk 1073741824" returned: 0 in 0.046s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.262s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.223s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.194s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-3ae6fa8a-25eb-440d-8f4a-ff5ecc93f780 req-e991b37e-2ac3-4d79-8496-b5fb2780fffb service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received event network-changed-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-3ae6fa8a-25eb-440d-8f4a-ff5ecc93f780 req-e991b37e-2ac3-4d79-8496-b5fb2780fffb service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Refreshing instance network info cache due to event network-changed-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3ae6fa8a-25eb-440d-8f4a-ff5ecc93f780 req-e991b37e-2ac3-4d79-8496-b5fb2780fffb service nova] Acquiring lock "refresh_cache-e7db38aa-7e5d-4b9a-a7f4-362819172489" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.216s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk 1073741824" returned: 0 in 0.052s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Cannot resize image /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Ensure instance console log exists: /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Updating instance_info_cache with network_info: [{"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Releasing lock "refresh_cache-e7db38aa-7e5d-4b9a-a7f4-362819172489" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Instance network_info: |[{"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3ae6fa8a-25eb-440d-8f4a-ff5ecc93f780 req-e991b37e-2ac3-4d79-8496-b5fb2780fffb service nova] Acquired lock "refresh_cache-e7db38aa-7e5d-4b9a-a7f4-362819172489" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.network.neutron [req-3ae6fa8a-25eb-440d-8f4a-ff5ecc93f780 req-e991b37e-2ac3-4d79-8496-b5fb2780fffb service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Refreshing network info cache for port 6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Cannot resize image /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Ensure instance console log exists: /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Start _get_guest_xml network_info=[{"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:15:54 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:15:54 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1361708087',display_name='tempest-DeleteServersTestJSON-server-1361708087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1361708087',id=1,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4bdba856e084870ad806f7f7b807bef',ramdisk_id='',reservation_id='r-q4x59myx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2037127427',owner_user_name='tempest-DeleteServersTestJSON-2037127427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:15:50Z,user_data=None,user_id='2f59ff0fdd8a4b9e8ae6242cfffdc772',uuid=e7db38aa-7e5d-4b9a-a7f4-362819172489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Converting VIF {"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:5c:a8,bridge_name='br-int',has_traffic_filtering=True,id=6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a,network=Network(c4cc5530-8005-4d14-9d4b-4535e599f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdbeeb7-71') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lazy-loading 'pci_devices' on Instance uuid e7db38aa-7e5d-4b9a-a7f4-362819172489 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:15:54 user nova-compute[75102]:   <uuid>e7db38aa-7e5d-4b9a-a7f4-362819172489</uuid>
Nov 10 16:15:54 user nova-compute[75102]:   <name>instance-00000001</name>
Nov 10 16:15:54 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:15:54 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:15:54 user nova-compute[75102]:   <metadata>
Nov 10 16:15:54 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:15:54 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:15:54 user nova-compute[75102]:       <nova:name>tempest-DeleteServersTestJSON-server-1361708087</nova:name>
Nov 10 16:15:54 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:15:54</nova:creationTime>
Nov 10 16:15:54 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:15:54 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:15:54 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:15:54 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:15:54 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:15:54 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:15:54 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:15:54 user nova-compute[75102]:       <nova:owner>
Nov 10 16:15:54 user nova-compute[75102]:         <nova:user uuid="2f59ff0fdd8a4b9e8ae6242cfffdc772">tempest-DeleteServersTestJSON-2037127427-project-member</nova:user>
Nov 10 16:15:54 user nova-compute[75102]:         <nova:project uuid="c4bdba856e084870ad806f7f7b807bef">tempest-DeleteServersTestJSON-2037127427</nova:project>
Nov 10 16:15:54 user nova-compute[75102]:       </nova:owner>
Nov 10 16:15:54 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:15:54 user nova-compute[75102]:       <nova:ports>
Nov 10 16:15:54 user nova-compute[75102]:         <nova:port uuid="6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a">
Nov 10 16:15:54 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 16:15:54 user nova-compute[75102]:         </nova:port>
Nov 10 16:15:54 user nova-compute[75102]:       </nova:ports>
Nov 10 16:15:54 user nova-compute[75102]:     </nova:instance>
Nov 10 16:15:54 user nova-compute[75102]:   </metadata>
Nov 10 16:15:54 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:15:54 user nova-compute[75102]:     <system>
Nov 10 16:15:54 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:15:54 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:15:54 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:15:54 user nova-compute[75102]:       <entry name="serial">e7db38aa-7e5d-4b9a-a7f4-362819172489</entry>
Nov 10 16:15:54 user nova-compute[75102]:       <entry name="uuid">e7db38aa-7e5d-4b9a-a7f4-362819172489</entry>
Nov 10 16:15:54 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:15:54 user nova-compute[75102]:     </system>
Nov 10 16:15:54 user nova-compute[75102]:   </sysinfo>
Nov 10 16:15:54 user nova-compute[75102]:   <os>
Nov 10 16:15:54 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:15:54 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:15:54 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:15:54 user nova-compute[75102]:   </os>
Nov 10 16:15:54 user nova-compute[75102]:   <features>
Nov 10 16:15:54 user nova-compute[75102]:     <acpi/>
Nov 10 16:15:54 user nova-compute[75102]:     <apic/>
Nov 10 16:15:54 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:15:54 user nova-compute[75102]:   </features>
Nov 10 16:15:54 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:15:54 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:15:54 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:15:54 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:15:54 user nova-compute[75102]:   </clock>
Nov 10 16:15:54 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:15:54 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:15:54 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:15:54 user nova-compute[75102]:   </cpu>
Nov 10 16:15:54 user nova-compute[75102]:   <devices>
Nov 10 16:15:54 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:15:54 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:15:54 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk"/>
Nov 10 16:15:54 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:15:54 user nova-compute[75102]:     </disk>
Nov 10 16:15:54 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:15:54 user nova-compute[75102]:       <mac address="fa:16:3e:06:5c:a8"/>
Nov 10 16:15:54 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:15:54 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:15:54 user nova-compute[75102]:       <target dev="tap6bdbeeb7-71"/>
Nov 10 16:15:54 user nova-compute[75102]:     </interface>
Nov 10 16:15:54 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:15:54 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/console.log" append="off"/>
Nov 10 16:15:54 user nova-compute[75102]:     </serial>
Nov 10 16:15:54 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:15:54 user nova-compute[75102]:     <video>
Nov 10 16:15:54 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:15:54 user nova-compute[75102]:     </video>
Nov 10 16:15:54 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:15:54 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:15:54 user nova-compute[75102]:     </rng>
Nov 10 16:15:54 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:15:54 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:15:54 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:15:54 user nova-compute[75102]:     </memballoon>
Nov 10 16:15:54 user nova-compute[75102]:   </devices>
Nov 10 16:15:54 user nova-compute[75102]: </domain>
Nov 10 16:15:54 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1361708087',display_name='tempest-DeleteServersTestJSON-server-1361708087',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1361708087',id=1,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4bdba856e084870ad806f7f7b807bef',ramdisk_id='',reservation_id='r-q4x59myx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-2037127427',owner_user_name='tempest-DeleteServersTestJSON-2037127427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:15:50Z,user_data=None,user_id='2f59ff0fdd8a4b9e8ae6242cfffdc772',uuid=e7db38aa-7e5d-4b9a-a7f4-362819172489,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Converting VIF {"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:06:5c:a8,bridge_name='br-int',has_traffic_filtering=True,id=6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a,network=Network(c4cc5530-8005-4d14-9d4b-4535e599f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdbeeb7-71') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG os_vif [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:5c:a8,bridge_name='br-int',has_traffic_filtering=True,id=6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a,network=Network(c4cc5530-8005-4d14-9d4b-4535e599f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdbeeb7-71') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:15:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Successfully created port: 53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Created schema index Interface.name {{(pid=75102) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Created schema index Port.name {{(pid=75102) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Created schema index Bridge.name {{(pid=75102) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [POLLOUT] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2302ba9e-6d0e-50ae-9b9a-a32377b9b642', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:15:55 user nova-compute[75102]: INFO oslo.privsep.daemon [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpnupwr3ll/privsep.sock']
Nov 10 16:15:55 user sudo[84420]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpnupwr3ll/privsep.sock
Nov 10 16:15:55 user sudo[84420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 16:15:56 user nova-compute[75102]: DEBUG nova.network.neutron [req-3ae6fa8a-25eb-440d-8f4a-ff5ecc93f780 req-e991b37e-2ac3-4d79-8496-b5fb2780fffb service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Updated VIF entry in instance network info cache for port 6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:15:56 user nova-compute[75102]: DEBUG nova.network.neutron [req-3ae6fa8a-25eb-440d-8f4a-ff5ecc93f780 req-e991b37e-2ac3-4d79-8496-b5fb2780fffb service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Updating instance_info_cache with network_info: [{"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:15:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3ae6fa8a-25eb-440d-8f4a-ff5ecc93f780 req-e991b37e-2ac3-4d79-8496-b5fb2780fffb service nova] Releasing lock "refresh_cache-e7db38aa-7e5d-4b9a-a7f4-362819172489" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:15:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Successfully updated port: 53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:15:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:15:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquired lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:15:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:15:56 user sudo[84420]: pam_unix(sudo:session): session closed for user root
Nov 10 16:15:56 user nova-compute[75102]: INFO oslo.privsep.daemon [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Spawned new privsep daemon via rootwrap
Nov 10 16:15:56 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 16:15:56 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 16:15:56 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 10 16:15:56 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84427
Nov 10 16:15:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-95e5e5ab-bb90-44b5-b66e-24efaa8f2fbf req-c8eeca91-a614-4984-8e81-159794be0660 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received event network-changed-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-95e5e5ab-bb90-44b5-b66e-24efaa8f2fbf req-c8eeca91-a614-4984-8e81-159794be0660 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Refreshing instance network info cache due to event network-changed-53486fff-1c8c-4c4b-b78c-2ef7deff3aec. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-95e5e5ab-bb90-44b5-b66e-24efaa8f2fbf req-c8eeca91-a614-4984-8e81-159794be0660 service nova] Acquiring lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6bdbeeb7-71, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6bdbeeb7-71, col_values=(('qos', UUID('3d911d76-81be-4164-a8a8-03043720dce9')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6bdbeeb7-71, col_values=(('external_ids', {'iface-id': '6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:06:5c:a8', 'vm-uuid': 'e7db38aa-7e5d-4b9a-a7f4-362819172489'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:57 user nova-compute[75102]: INFO os_vif [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:06:5c:a8,bridge_name='br-int',has_traffic_filtering=True,id=6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a,network=Network(c4cc5530-8005-4d14-9d4b-4535e599f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdbeeb7-71')
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] No VIF found with MAC fa:16:3e:06:5c:a8, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:15:57 user nova-compute[75102]: INFO nova.compute.claims [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Claim successful on node user
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updating instance_info_cache with network_info: [{"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Releasing lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Instance network_info: |[{"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-95e5e5ab-bb90-44b5-b66e-24efaa8f2fbf req-c8eeca91-a614-4984-8e81-159794be0660 service nova] Acquired lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.network.neutron [req-95e5e5ab-bb90-44b5-b66e-24efaa8f2fbf req-c8eeca91-a614-4984-8e81-159794be0660 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Refreshing network info cache for port 53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Start _get_guest_xml network_info=[{"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:15:57 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:15:57 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:15:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1190915998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1190915998',id=2,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-256czwv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:15:53Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=f11c84d6-ac5c-4301-b4e3-90fa5dc1e585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=53486fff-1c8c-4c4b-b78c-2ef7deff3aec,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53486fff-1c') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.objects.instance [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'pci_devices' on Instance uuid f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:15:58 user nova-compute[75102]:   <uuid>f11c84d6-ac5c-4301-b4e3-90fa5dc1e585</uuid>
Nov 10 16:15:58 user nova-compute[75102]:   <name>instance-00000002</name>
Nov 10 16:15:58 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:15:58 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:15:58 user nova-compute[75102]:   <metadata>
Nov 10 16:15:58 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:15:58 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:15:58 user nova-compute[75102]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1190915998</nova:name>
Nov 10 16:15:58 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:15:57</nova:creationTime>
Nov 10 16:15:58 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:15:58 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:15:58 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:15:58 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:15:58 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:15:58 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:15:58 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:15:58 user nova-compute[75102]:       <nova:owner>
Nov 10 16:15:58 user nova-compute[75102]:         <nova:user uuid="3149d0620bf64829aa4eec99a2cddee5">tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member</nova:user>
Nov 10 16:15:58 user nova-compute[75102]:         <nova:project uuid="c0e926f56f914e7488a50f5bb78a33cd">tempest-ServerBootFromVolumeStableRescueTest-918868864</nova:project>
Nov 10 16:15:58 user nova-compute[75102]:       </nova:owner>
Nov 10 16:15:58 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:15:58 user nova-compute[75102]:       <nova:ports>
Nov 10 16:15:58 user nova-compute[75102]:         <nova:port uuid="53486fff-1c8c-4c4b-b78c-2ef7deff3aec">
Nov 10 16:15:58 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 16:15:58 user nova-compute[75102]:         </nova:port>
Nov 10 16:15:58 user nova-compute[75102]:       </nova:ports>
Nov 10 16:15:58 user nova-compute[75102]:     </nova:instance>
Nov 10 16:15:58 user nova-compute[75102]:   </metadata>
Nov 10 16:15:58 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:15:58 user nova-compute[75102]:     <system>
Nov 10 16:15:58 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:15:58 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:15:58 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:15:58 user nova-compute[75102]:       <entry name="serial">f11c84d6-ac5c-4301-b4e3-90fa5dc1e585</entry>
Nov 10 16:15:58 user nova-compute[75102]:       <entry name="uuid">f11c84d6-ac5c-4301-b4e3-90fa5dc1e585</entry>
Nov 10 16:15:58 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:15:58 user nova-compute[75102]:     </system>
Nov 10 16:15:58 user nova-compute[75102]:   </sysinfo>
Nov 10 16:15:58 user nova-compute[75102]:   <os>
Nov 10 16:15:58 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:15:58 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:15:58 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:15:58 user nova-compute[75102]:   </os>
Nov 10 16:15:58 user nova-compute[75102]:   <features>
Nov 10 16:15:58 user nova-compute[75102]:     <acpi/>
Nov 10 16:15:58 user nova-compute[75102]:     <apic/>
Nov 10 16:15:58 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:15:58 user nova-compute[75102]:   </features>
Nov 10 16:15:58 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:15:58 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:15:58 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:15:58 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:15:58 user nova-compute[75102]:   </clock>
Nov 10 16:15:58 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:15:58 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:15:58 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:15:58 user nova-compute[75102]:   </cpu>
Nov 10 16:15:58 user nova-compute[75102]:   <devices>
Nov 10 16:15:58 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:15:58 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:15:58 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk"/>
Nov 10 16:15:58 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:15:58 user nova-compute[75102]:     </disk>
Nov 10 16:15:58 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:15:58 user nova-compute[75102]:       <mac address="fa:16:3e:48:d1:12"/>
Nov 10 16:15:58 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:15:58 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:15:58 user nova-compute[75102]:       <target dev="tap53486fff-1c"/>
Nov 10 16:15:58 user nova-compute[75102]:     </interface>
Nov 10 16:15:58 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:15:58 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/console.log" append="off"/>
Nov 10 16:15:58 user nova-compute[75102]:     </serial>
Nov 10 16:15:58 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:15:58 user nova-compute[75102]:     <video>
Nov 10 16:15:58 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:15:58 user nova-compute[75102]:     </video>
Nov 10 16:15:58 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:15:58 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:15:58 user nova-compute[75102]:     </rng>
Nov 10 16:15:58 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:15:58 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:15:58 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:15:58 user nova-compute[75102]:     </memballoon>
Nov 10 16:15:58 user nova-compute[75102]:   </devices>
Nov 10 16:15:58 user nova-compute[75102]: </domain>
Nov 10 16:15:58 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1190915998',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1190915998',id=2,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-256czwv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:15:53Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=f11c84d6-ac5c-4301-b4e3-90fa5dc1e585,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=53486fff-1c8c-4c4b-b78c-2ef7deff3aec,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53486fff-1c') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG os_vif [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=53486fff-1c8c-4c4b-b78c-2ef7deff3aec,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53486fff-1c') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fe19c5e9-0917-5184-9fd7-26fa0edac730', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53486fff-1c, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53486fff-1c, col_values=(('qos', UUID('0264a573-950e-4142-b4f7-5fcf844fa62b')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53486fff-1c, col_values=(('external_ids', {'iface-id': '53486fff-1c8c-4c4b-b78c-2ef7deff3aec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:d1:12', 'vm-uuid': 'f11c84d6-ac5c-4301-b4e3-90fa5dc1e585'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:58 user nova-compute[75102]: INFO os_vif [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=53486fff-1c8c-4c4b-b78c-2ef7deff3aec,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53486fff-1c')
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No VIF found with MAC fa:16:3e:48:d1:12, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.443s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:15:58 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:15:58 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Creating image(s)
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "/opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "/opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "/opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG nova.policy [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8fb6cbfdc7334af4a5e4cae046d2e6b1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7d5f31d051084698bce41a77bc9faa87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.226s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk 1073741824" returned: 0 in 0.047s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG nova.network.neutron [req-95e5e5ab-bb90-44b5-b66e-24efaa8f2fbf req-c8eeca91-a614-4984-8e81-159794be0660 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updated VIF entry in instance network info cache for port 53486fff-1c8c-4c4b-b78c-2ef7deff3aec. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG nova.network.neutron [req-95e5e5ab-bb90-44b5-b66e-24efaa8f2fbf req-c8eeca91-a614-4984-8e81-159794be0660 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updating instance_info_cache with network_info: [{"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-95e5e5ab-bb90-44b5-b66e-24efaa8f2fbf req-c8eeca91-a614-4984-8e81-159794be0660 service nova] Releasing lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.160s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Cannot resize image /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Ensure instance console log exists: /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:15:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Successfully created port: 73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:16:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:16:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Instance spawned successfully.
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:16:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Instance spawned successfully.
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:02 user nova-compute[75102]: INFO nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Took 9.74 seconds to spawn the instance on the hypervisor.
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:16:02 user nova-compute[75102]: INFO nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Took 12.31 seconds to spawn the instance on the hypervisor.
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Successfully updated port: 73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquired lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:16:02 user nova-compute[75102]: INFO nova.compute.manager [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Took 13.63 seconds to build instance.
Nov 10 16:16:02 user nova-compute[75102]: INFO nova.compute.manager [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Took 10.83 seconds to build instance.
Nov 10 16:16:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d35b86c-c033-4e02-8b44-d88a0dc3cb7b tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.897s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-59494cfd-7c16-4ab1-9ecf-1db0f4d5f3b7 req-0683bd94-2135-4fb6-8c7b-7c40ad4be365 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-changed-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-59494cfd-7c16-4ab1-9ecf-1db0f4d5f3b7 req-0683bd94-2135-4fb6-8c7b-7c40ad4be365 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Refreshing instance network info cache due to event network-changed-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59494cfd-7c16-4ab1-9ecf-1db0f4d5f3b7 req-0683bd94-2135-4fb6-8c7b-7c40ad4be365 service nova] Acquiring lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cd8d94b-0755-4ca8-960c-9414ff04a7b5 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.016s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:16:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.network.neutron [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Releasing lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance network_info: |[{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59494cfd-7c16-4ab1-9ecf-1db0f4d5f3b7 req-0683bd94-2135-4fb6-8c7b-7c40ad4be365 service nova] Acquired lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-59494cfd-7c16-4ab1-9ecf-1db0f4d5f3b7 req-0683bd94-2135-4fb6-8c7b-7c40ad4be365 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Refreshing network info cache for port 73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Start _get_guest_xml network_info=[{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:16:04 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:04 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1376797735',display_name='tempest-ServerActionsTestOtherB-server-1376797735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1376797735',id=3,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHr0jwe70jfLAKGRmlC9Z1xJ9zp5YI31PlNstF6fiupDKXJEjbBPAkoJ7zXlYnnaeafbpydLq7gUD5yOQPm6w6xcEQdooK67LWtISX7OzOkN1IUKn+FbDIXcoKGGroQQ==',key_name='tempest-keypair-1977714077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d5f31d051084698bce41a77bc9faa87',ramdisk_id='',reservation_id='r-gdlg319g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-792699016',owner_user_name='tempest-ServerActionsTestOtherB-792699016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb6cbfdc7334af4a5e4cae046d2e6b1',uuid=731624eb-b0c0-42c1-80cf-2dd76932e92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converting VIF {"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.objects.instance [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lazy-loading 'pci_devices' on Instance uuid 731624eb-b0c0-42c1-80cf-2dd76932e92a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:16:04 user nova-compute[75102]:   <uuid>731624eb-b0c0-42c1-80cf-2dd76932e92a</uuid>
Nov 10 16:16:04 user nova-compute[75102]:   <name>instance-00000003</name>
Nov 10 16:16:04 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:16:04 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:16:04 user nova-compute[75102]:   <metadata>
Nov 10 16:16:04 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:16:04 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:16:04 user nova-compute[75102]:       <nova:name>tempest-ServerActionsTestOtherB-server-1376797735</nova:name>
Nov 10 16:16:04 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:16:04</nova:creationTime>
Nov 10 16:16:04 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:16:04 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:16:04 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:16:04 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:16:04 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:16:04 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:16:04 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:16:04 user nova-compute[75102]:       <nova:owner>
Nov 10 16:16:04 user nova-compute[75102]:         <nova:user uuid="8fb6cbfdc7334af4a5e4cae046d2e6b1">tempest-ServerActionsTestOtherB-792699016-project-member</nova:user>
Nov 10 16:16:04 user nova-compute[75102]:         <nova:project uuid="7d5f31d051084698bce41a77bc9faa87">tempest-ServerActionsTestOtherB-792699016</nova:project>
Nov 10 16:16:04 user nova-compute[75102]:       </nova:owner>
Nov 10 16:16:04 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:16:04 user nova-compute[75102]:       <nova:ports>
Nov 10 16:16:04 user nova-compute[75102]:         <nova:port uuid="73a78287-ce4f-4bf1-b9aa-e5eecbc4a608">
Nov 10 16:16:04 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 16:16:04 user nova-compute[75102]:         </nova:port>
Nov 10 16:16:04 user nova-compute[75102]:       </nova:ports>
Nov 10 16:16:04 user nova-compute[75102]:     </nova:instance>
Nov 10 16:16:04 user nova-compute[75102]:   </metadata>
Nov 10 16:16:04 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:16:04 user nova-compute[75102]:     <system>
Nov 10 16:16:04 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:16:04 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:16:04 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:16:04 user nova-compute[75102]:       <entry name="serial">731624eb-b0c0-42c1-80cf-2dd76932e92a</entry>
Nov 10 16:16:04 user nova-compute[75102]:       <entry name="uuid">731624eb-b0c0-42c1-80cf-2dd76932e92a</entry>
Nov 10 16:16:04 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:16:04 user nova-compute[75102]:     </system>
Nov 10 16:16:04 user nova-compute[75102]:   </sysinfo>
Nov 10 16:16:04 user nova-compute[75102]:   <os>
Nov 10 16:16:04 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:16:04 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:16:04 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:16:04 user nova-compute[75102]:   </os>
Nov 10 16:16:04 user nova-compute[75102]:   <features>
Nov 10 16:16:04 user nova-compute[75102]:     <acpi/>
Nov 10 16:16:04 user nova-compute[75102]:     <apic/>
Nov 10 16:16:04 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:16:04 user nova-compute[75102]:   </features>
Nov 10 16:16:04 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:16:04 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:16:04 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:16:04 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:16:04 user nova-compute[75102]:   </clock>
Nov 10 16:16:04 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:16:04 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:16:04 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:16:04 user nova-compute[75102]:   </cpu>
Nov 10 16:16:04 user nova-compute[75102]:   <devices>
Nov 10 16:16:04 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:16:04 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:16:04 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk"/>
Nov 10 16:16:04 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:16:04 user nova-compute[75102]:     </disk>
Nov 10 16:16:04 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:16:04 user nova-compute[75102]:       <mac address="fa:16:3e:f8:94:15"/>
Nov 10 16:16:04 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:04 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:16:04 user nova-compute[75102]:       <target dev="tap73a78287-ce"/>
Nov 10 16:16:04 user nova-compute[75102]:     </interface>
Nov 10 16:16:04 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:16:04 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/console.log" append="off"/>
Nov 10 16:16:04 user nova-compute[75102]:     </serial>
Nov 10 16:16:04 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:16:04 user nova-compute[75102]:     <video>
Nov 10 16:16:04 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:04 user nova-compute[75102]:     </video>
Nov 10 16:16:04 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:16:04 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:16:04 user nova-compute[75102]:     </rng>
Nov 10 16:16:04 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:16:04 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:16:04 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:16:04 user nova-compute[75102]:     </memballoon>
Nov 10 16:16:04 user nova-compute[75102]:   </devices>
Nov 10 16:16:04 user nova-compute[75102]: </domain>
Nov 10 16:16:04 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1376797735',display_name='tempest-ServerActionsTestOtherB-server-1376797735',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1376797735',id=3,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHr0jwe70jfLAKGRmlC9Z1xJ9zp5YI31PlNstF6fiupDKXJEjbBPAkoJ7zXlYnnaeafbpydLq7gUD5yOQPm6w6xcEQdooK67LWtISX7OzOkN1IUKn+FbDIXcoKGGroQQ==',key_name='tempest-keypair-1977714077',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7d5f31d051084698bce41a77bc9faa87',ramdisk_id='',reservation_id='r-gdlg319g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-792699016',owner_user_name='tempest-ServerActionsTestOtherB-792699016-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:15:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb6cbfdc7334af4a5e4cae046d2e6b1',uuid=731624eb-b0c0-42c1-80cf-2dd76932e92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converting VIF {"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG os_vif [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab7b28ba-0834-56fe-8f2e-652ae41dd722', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73a78287-ce, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73a78287-ce, col_values=(('qos', UUID('ffd32767-d668-466e-9ce5-8ab50fe2c068')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73a78287-ce, col_values=(('external_ids', {'iface-id': '73a78287-ce4f-4bf1-b9aa-e5eecbc4a608', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:94:15', 'vm-uuid': '731624eb-b0c0-42c1-80cf-2dd76932e92a'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:04 user nova-compute[75102]: INFO os_vif [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce')
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] No VIF found with MAC fa:16:3e:f8:94:15, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:16:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-59494cfd-7c16-4ab1-9ecf-1db0f4d5f3b7 req-0683bd94-2135-4fb6-8c7b-7c40ad4be365 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updated VIF entry in instance network info cache for port 73a78287-ce4f-4bf1-b9aa-e5eecbc4a608. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-59494cfd-7c16-4ab1-9ecf-1db0f4d5f3b7 req-0683bd94-2135-4fb6-8c7b-7c40ad4be365 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59494cfd-7c16-4ab1-9ecf-1db0f4d5f3b7 req-0683bd94-2135-4fb6-8c7b-7c40ad4be365 service nova] Releasing lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-7cc415d6-f2cf-449d-8236-c0eeff7956d6 req-216a9ab3-0a70-4ba5-98b3-f4708ca41f37 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received event network-vif-plugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7cc415d6-f2cf-449d-8236-c0eeff7956d6 req-216a9ab3-0a70-4ba5-98b3-f4708ca41f37 service nova] Acquiring lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7cc415d6-f2cf-449d-8236-c0eeff7956d6 req-216a9ab3-0a70-4ba5-98b3-f4708ca41f37 service nova] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7cc415d6-f2cf-449d-8236-c0eeff7956d6 req-216a9ab3-0a70-4ba5-98b3-f4708ca41f37 service nova] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-7cc415d6-f2cf-449d-8236-c0eeff7956d6 req-216a9ab3-0a70-4ba5-98b3-f4708ca41f37 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] No waiting events found dispatching network-vif-plugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:06 user nova-compute[75102]: WARNING nova.compute.manager [req-7cc415d6-f2cf-449d-8236-c0eeff7956d6 req-216a9ab3-0a70-4ba5-98b3-f4708ca41f37 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received unexpected event network-vif-plugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a for instance with vm_state active and task_state None.
Nov 10 16:16:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received event network-vif-plugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] Acquiring lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] No waiting events found dispatching network-vif-plugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:08 user nova-compute[75102]: WARNING nova.compute.manager [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received unexpected event network-vif-plugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a for instance with vm_state active and task_state None.
Nov 10 16:16:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received event network-vif-plugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] Acquiring lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] No waiting events found dispatching network-vif-plugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:08 user nova-compute[75102]: WARNING nova.compute.manager [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received unexpected event network-vif-plugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec for instance with vm_state active and task_state None.
Nov 10 16:16:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received event network-vif-plugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] Acquiring lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] No waiting events found dispatching network-vif-plugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:08 user nova-compute[75102]: WARNING nova.compute.manager [req-c8b3fc28-6689-4548-b9f3-9dafa5372fcb req-4228baeb-887f-411f-b214-35faa9e5ed85 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received unexpected event network-vif-plugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec for instance with vm_state active and task_state None.
Nov 10 16:16:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:16:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance spawned successfully.
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:10 user nova-compute[75102]: INFO nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Took 11.91 seconds to spawn the instance on the hypervisor.
Nov 10 16:16:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:16:10 user nova-compute[75102]: INFO nova.compute.manager [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Took 12.84 seconds to build instance.
Nov 10 16:16:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-92ff39a5-75b7-4f69-8a51-3a5a7f30bdd7 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.028s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:16:15 user nova-compute[75102]: INFO nova.compute.claims [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Claim successful on node user
Nov 10 16:16:15 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:16:15 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:16:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 10 16:16:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG nova.policy [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '967fff952d084989b19cc487c4773e22', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0637a4e0453f4b8195d49cae42dc7de1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:16:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Creating image(s)
Nov 10 16:16:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "/opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "/opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "/opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "27d411d13a3544a43ae67c75279e7e206cb4ad10" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "27d411d13a3544a43ae67c75279e7e206cb4ad10" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10.part --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Successfully created port: d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:16:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10.part --force-share --output=json" returned: 0 in 0.273s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:17 user nova-compute[75102]: DEBUG nova.virt.images [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] 93d1197e-a00f-4bbb-abd4-a779d86970de was qcow2, converting to raw {{(pid=75102) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 16:16:17 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:16:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10.part /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10.converted {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10.part /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10.converted" returned: 0 in 0.491s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10.converted --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10.converted --force-share --output=json" returned: 0 in 0.233s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "27d411d13a3544a43ae67c75279e7e206cb4ad10" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.575s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Successfully updated port: d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10 --force-share --output=json" returned: 0 in 0.278s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "27d411d13a3544a43ae67c75279e7e206cb4ad10" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "27d411d13a3544a43ae67c75279e7e206cb4ad10" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquired lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-5ac29c99-5015-45c6-958e-4509d0edbe43 req-4c44fea4-959a-4f58-bcf6-7307bf7fd862 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-changed-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-5ac29c99-5015-45c6-958e-4509d0edbe43 req-4c44fea4-959a-4f58-bcf6-7307bf7fd862 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Refreshing instance network info cache due to event network-changed-d00f79b8-7518-4a77-a447-16d1ebcf0be1. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5ac29c99-5015-45c6-958e-4509d0edbe43 req-4c44fea4-959a-4f58-bcf6-7307bf7fd862 service nova] Acquiring lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10 --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10,backing_fmt=raw /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10,backing_fmt=raw /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk 1073741824" returned: 0 in 0.061s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "27d411d13a3544a43ae67c75279e7e206cb4ad10" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10 --force-share --output=json" returned: 0 in 0.245s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Cannot resize image /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Ensure instance console log exists: /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updating instance_info_cache with network_info: [{"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Releasing lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Instance network_info: |[{"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5ac29c99-5015-45c6-958e-4509d0edbe43 req-4c44fea4-959a-4f58-bcf6-7307bf7fd862 service nova] Acquired lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-5ac29c99-5015-45c6-958e-4509d0edbe43 req-4c44fea4-959a-4f58-bcf6-7307bf7fd862 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Refreshing network info cache for port d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Start _get_guest_xml network_info=[{"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:16:07Z,direct_url=<?>,disk_format='qcow2',id=93d1197e-a00f-4bbb-abd4-a779d86970de,min_disk=0,min_ram=0,name='',owner='4a6b5588dda14294ae875474862679e5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:16:10Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'boot_index': 0, 'disk_bus': 'scsi', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '93d1197e-a00f-4bbb-abd4-a779d86970de'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:16:18 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:18 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:16:07Z,direct_url=<?>,disk_format='qcow2',id=93d1197e-a00f-4bbb-abd4-a779d86970de,min_disk=0,min_ram=0,name='',owner='4a6b5588dda14294ae875474862679e5',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:16:10Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:16:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1578654316',display_name='tempest-AttachSCSIVolumeTestJSON-server-1578654316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1578654316',id=4,image_ref='93d1197e-a00f-4bbb-abd4-a779d86970de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtcdZnCaIq1Iz2tJdyNq67KlNym1pavQH0r3h+vs4/buHNn/+KxjJ79zEbRuWHiRHAooVo1wOFR5WYiL5EvU54/YNqtrBKoUimby6mp6rh5YHsTZudCfDimLklXfKmACg==',key_name='tempest-keypair-996940272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0637a4e0453f4b8195d49cae42dc7de1',ramdisk_id='',reservation_id='r-ulq6nf4h',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='93d1197e-a00f-4bbb-abd4-a779d86970de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1281465552',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1281465552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='967fff952d084989b19cc487c4773e22',uuid=cc9e365b-8b0a-40db-bbc4-026f609cdd7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Converting VIF {"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:1e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d00f79b8-7518-4a77-a447-16d1ebcf0be1,network=Network(affc9dec-d2f2-47b4-afe2-3c5a370f3a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd00f79b8-75') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.objects.instance [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lazy-loading 'pci_devices' on Instance uuid cc9e365b-8b0a-40db-bbc4-026f609cdd7a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:16:19 user nova-compute[75102]:   <uuid>cc9e365b-8b0a-40db-bbc4-026f609cdd7a</uuid>
Nov 10 16:16:19 user nova-compute[75102]:   <name>instance-00000004</name>
Nov 10 16:16:19 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:16:19 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:16:19 user nova-compute[75102]:   <metadata>
Nov 10 16:16:19 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:16:19 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:16:19 user nova-compute[75102]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-1578654316</nova:name>
Nov 10 16:16:19 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:16:18</nova:creationTime>
Nov 10 16:16:19 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:16:19 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:16:19 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:16:19 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:16:19 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:16:19 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:16:19 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:16:19 user nova-compute[75102]:       <nova:owner>
Nov 10 16:16:19 user nova-compute[75102]:         <nova:user uuid="967fff952d084989b19cc487c4773e22">tempest-AttachSCSIVolumeTestJSON-1281465552-project-member</nova:user>
Nov 10 16:16:19 user nova-compute[75102]:         <nova:project uuid="0637a4e0453f4b8195d49cae42dc7de1">tempest-AttachSCSIVolumeTestJSON-1281465552</nova:project>
Nov 10 16:16:19 user nova-compute[75102]:       </nova:owner>
Nov 10 16:16:19 user nova-compute[75102]:       <nova:root type="image" uuid="93d1197e-a00f-4bbb-abd4-a779d86970de"/>
Nov 10 16:16:19 user nova-compute[75102]:       <nova:ports>
Nov 10 16:16:19 user nova-compute[75102]:         <nova:port uuid="d00f79b8-7518-4a77-a447-16d1ebcf0be1">
Nov 10 16:16:19 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 16:16:19 user nova-compute[75102]:         </nova:port>
Nov 10 16:16:19 user nova-compute[75102]:       </nova:ports>
Nov 10 16:16:19 user nova-compute[75102]:     </nova:instance>
Nov 10 16:16:19 user nova-compute[75102]:   </metadata>
Nov 10 16:16:19 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:16:19 user nova-compute[75102]:     <system>
Nov 10 16:16:19 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:16:19 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:16:19 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:16:19 user nova-compute[75102]:       <entry name="serial">cc9e365b-8b0a-40db-bbc4-026f609cdd7a</entry>
Nov 10 16:16:19 user nova-compute[75102]:       <entry name="uuid">cc9e365b-8b0a-40db-bbc4-026f609cdd7a</entry>
Nov 10 16:16:19 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:16:19 user nova-compute[75102]:     </system>
Nov 10 16:16:19 user nova-compute[75102]:   </sysinfo>
Nov 10 16:16:19 user nova-compute[75102]:   <os>
Nov 10 16:16:19 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:16:19 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:16:19 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:16:19 user nova-compute[75102]:   </os>
Nov 10 16:16:19 user nova-compute[75102]:   <features>
Nov 10 16:16:19 user nova-compute[75102]:     <acpi/>
Nov 10 16:16:19 user nova-compute[75102]:     <apic/>
Nov 10 16:16:19 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:16:19 user nova-compute[75102]:   </features>
Nov 10 16:16:19 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:16:19 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:16:19 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:16:19 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:16:19 user nova-compute[75102]:   </clock>
Nov 10 16:16:19 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:16:19 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:16:19 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:16:19 user nova-compute[75102]:   </cpu>
Nov 10 16:16:19 user nova-compute[75102]:   <devices>
Nov 10 16:16:19 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:16:19 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:16:19 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk"/>
Nov 10 16:16:19 user nova-compute[75102]:       <target dev="sda" bus="scsi"/>
Nov 10 16:16:19 user nova-compute[75102]:       <address type="drive" controller="0" unit="0"/>
Nov 10 16:16:19 user nova-compute[75102]:     </disk>
Nov 10 16:16:19 user nova-compute[75102]:     <disk type="file" device="cdrom">
Nov 10 16:16:19 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 16:16:19 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk.config"/>
Nov 10 16:16:19 user nova-compute[75102]:       <target dev="sdb" bus="scsi"/>
Nov 10 16:16:19 user nova-compute[75102]:       <address type="drive" controller="0" unit="1"/>
Nov 10 16:16:19 user nova-compute[75102]:     </disk>
Nov 10 16:16:19 user nova-compute[75102]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 10 16:16:19 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:16:19 user nova-compute[75102]:       <mac address="fa:16:3e:e6:1e:7d"/>
Nov 10 16:16:19 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:19 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:16:19 user nova-compute[75102]:       <target dev="tapd00f79b8-75"/>
Nov 10 16:16:19 user nova-compute[75102]:     </interface>
Nov 10 16:16:19 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:16:19 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/console.log" append="off"/>
Nov 10 16:16:19 user nova-compute[75102]:     </serial>
Nov 10 16:16:19 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:16:19 user nova-compute[75102]:     <video>
Nov 10 16:16:19 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:19 user nova-compute[75102]:     </video>
Nov 10 16:16:19 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:16:19 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:16:19 user nova-compute[75102]:     </rng>
Nov 10 16:16:19 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:16:19 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:16:19 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:16:19 user nova-compute[75102]:     </memballoon>
Nov 10 16:16:19 user nova-compute[75102]:   </devices>
Nov 10 16:16:19 user nova-compute[75102]: </domain>
Nov 10 16:16:19 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1578654316',display_name='tempest-AttachSCSIVolumeTestJSON-server-1578654316',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1578654316',id=4,image_ref='93d1197e-a00f-4bbb-abd4-a779d86970de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtcdZnCaIq1Iz2tJdyNq67KlNym1pavQH0r3h+vs4/buHNn/+KxjJ79zEbRuWHiRHAooVo1wOFR5WYiL5EvU54/YNqtrBKoUimby6mp6rh5YHsTZudCfDimLklXfKmACg==',key_name='tempest-keypair-996940272',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0637a4e0453f4b8195d49cae42dc7de1',ramdisk_id='',reservation_id='r-ulq6nf4h',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='93d1197e-a00f-4bbb-abd4-a779d86970de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1281465552',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1281465552-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:16:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='967fff952d084989b19cc487c4773e22',uuid=cc9e365b-8b0a-40db-bbc4-026f609cdd7a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Converting VIF {"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e6:1e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d00f79b8-7518-4a77-a447-16d1ebcf0be1,network=Network(affc9dec-d2f2-47b4-afe2-3c5a370f3a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd00f79b8-75') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG os_vif [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:1e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d00f79b8-7518-4a77-a447-16d1ebcf0be1,network=Network(affc9dec-d2f2-47b4-afe2-3c5a370f3a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd00f79b8-75') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9bcfc5e1-2553-5730-a5e6-df2bb8cc935c', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd00f79b8-75, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd00f79b8-75, col_values=(('qos', UUID('4421ac3f-e9cc-4e75-a8de-4856ab483740')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd00f79b8-75, col_values=(('external_ids', {'iface-id': 'd00f79b8-7518-4a77-a447-16d1ebcf0be1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e6:1e:7d', 'vm-uuid': 'cc9e365b-8b0a-40db-bbc4-026f609cdd7a'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:19 user nova-compute[75102]: INFO os_vif [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e6:1e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d00f79b8-7518-4a77-a447-16d1ebcf0be1,network=Network(affc9dec-d2f2-47b4-afe2-3c5a370f3a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd00f79b8-75')
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] No BDM found with device name sda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] No VIF found with MAC fa:16:3e:e6:1e:7d, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:16:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Using config drive
Nov 10 16:16:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Creating config drive at /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk.config
Nov 10 16:16:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkbxbdxki {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpkbxbdxki" returned: 0 in 0.054s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.network.neutron [req-5ac29c99-5015-45c6-958e-4509d0edbe43 req-4c44fea4-959a-4f58-bcf6-7307bf7fd862 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updated VIF entry in instance network info cache for port d00f79b8-7518-4a77-a447-16d1ebcf0be1. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG nova.network.neutron [req-5ac29c99-5015-45c6-958e-4509d0edbe43 req-4c44fea4-959a-4f58-bcf6-7307bf7fd862 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updating instance_info_cache with network_info: [{"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5ac29c99-5015-45c6-958e-4509d0edbe43 req-4c44fea4-959a-4f58-bcf6-7307bf7fd862 service nova] Releasing lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-1fb3535f-afc3-47fd-a071-e01428d1853f req-e262e134-8c63-41f1-ad3d-38782f5bfa07 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1fb3535f-afc3-47fd-a071-e01428d1853f req-e262e134-8c63-41f1-ad3d-38782f5bfa07 service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1fb3535f-afc3-47fd-a071-e01428d1853f req-e262e134-8c63-41f1-ad3d-38782f5bfa07 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1fb3535f-afc3-47fd-a071-e01428d1853f req-e262e134-8c63-41f1-ad3d-38782f5bfa07 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-1fb3535f-afc3-47fd-a071-e01428d1853f req-e262e134-8c63-41f1-ad3d-38782f5bfa07 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:20 user nova-compute[75102]: WARNING nova.compute.manager [req-1fb3535f-afc3-47fd-a071-e01428d1853f req-e262e134-8c63-41f1-ad3d-38782f5bfa07 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state active and task_state None.
Nov 10 16:16:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-df35909b-4bc8-47b3-9e75-0095b78c438b req-fd98b44f-c782-480f-a8a7-4724ac671833 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-df35909b-4bc8-47b3-9e75-0095b78c438b req-fd98b44f-c782-480f-a8a7-4724ac671833 service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-df35909b-4bc8-47b3-9e75-0095b78c438b req-fd98b44f-c782-480f-a8a7-4724ac671833 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-df35909b-4bc8-47b3-9e75-0095b78c438b req-fd98b44f-c782-480f-a8a7-4724ac671833 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-df35909b-4bc8-47b3-9e75-0095b78c438b req-fd98b44f-c782-480f-a8a7-4724ac671833 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:22 user nova-compute[75102]: WARNING nova.compute.manager [req-df35909b-4bc8-47b3-9e75-0095b78c438b req-fd98b44f-c782-480f-a8a7-4724ac671833 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state active and task_state None.
Nov 10 16:16:23 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:16:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:16:23 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Instance spawned successfully.
Nov 10 16:16:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:16:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:23 user nova-compute[75102]: INFO nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Took 7.53 seconds to spawn the instance on the hypervisor.
Nov 10 16:16:23 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:16:23 user nova-compute[75102]: INFO nova.compute.manager [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Took 8.57 seconds to build instance.
Nov 10 16:16:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9b2567bb-d7da-4573-b64f-76ff67b3b3cb tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.729s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:16:27 user nova-compute[75102]: INFO nova.compute.claims [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Claim successful on node user
Nov 10 16:16:27 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.397s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:16:27 user nova-compute[75102]: DEBUG nova.network.neutron [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:16:27 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:16:27 user nova-compute[75102]: DEBUG nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG nova.policy [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1899a5a4fd34eff90dfe1e462e3ac9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0ee93b8e5c4a41f6bf60c6b1e8b2f481', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:16:28 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Creating image(s)
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquiring lock "/opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "/opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "/opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.338s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.239s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk 1073741824" returned: 0 in 0.063s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.309s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Successfully created port: d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Cannot resize image /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Ensure instance console log exists: /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Successfully updated port: d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquiring lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquired lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-e2a418fe-bcf7-4528-a981-10600d74ac4d req-583467e6-c2a1-4a2b-8996-3dcae82d6e15 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received event network-changed-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-e2a418fe-bcf7-4528-a981-10600d74ac4d req-583467e6-c2a1-4a2b-8996-3dcae82d6e15 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Refreshing instance network info cache due to event network-changed-d9965142-35ab-44e0-82bc-b3e8099c58ad. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e2a418fe-bcf7-4528-a981-10600d74ac4d req-583467e6-c2a1-4a2b-8996-3dcae82d6e15 service nova] Acquiring lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Updating instance_info_cache with network_info: [{"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Releasing lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Instance network_info: |[{"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e2a418fe-bcf7-4528-a981-10600d74ac4d req-583467e6-c2a1-4a2b-8996-3dcae82d6e15 service nova] Acquired lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.network.neutron [req-e2a418fe-bcf7-4528-a981-10600d74ac4d req-583467e6-c2a1-4a2b-8996-3dcae82d6e15 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Refreshing network info cache for port d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Start _get_guest_xml network_info=[{"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:16:30 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:30 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-908239677',display_name='tempest-VolumesAssistedSnapshotsTest-server-908239677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-908239677',id=5,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTXCDjnhkUxFfKOhd5giJVqvsNp9rhiLlvtXOgpcbhyMOC7DZIwLO/Ju71GBvfWBmAHdOYb3UzJ4VZhhSdXi1NYqROmv3YiPKSGThT9p9tqcQz8sd4YulkrZS5RqL9S6Q==',key_name='tempest-keypair-1951149358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee93b8e5c4a41f6bf60c6b1e8b2f481',ramdisk_id='',reservation_id='r-iu81dcoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-725875834',owner_user_name='tempest-VolumesAssistedSnapshotsTest-725875834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1899a5a4fd34eff90dfe1e462e3ac9c',uuid=83ad82f3-4e34-46fd-94a6-71adb8884eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Converting VIF {"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:fa:9a,bridge_name='br-int',has_traffic_filtering=True,id=d9965142-35ab-44e0-82bc-b3e8099c58ad,network=Network(eee502f0-b9d7-4872-b58d-927cfbaa1b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9965142-35') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.objects.instance [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lazy-loading 'pci_devices' on Instance uuid 83ad82f3-4e34-46fd-94a6-71adb8884eda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:16:30 user nova-compute[75102]:   <uuid>83ad82f3-4e34-46fd-94a6-71adb8884eda</uuid>
Nov 10 16:16:30 user nova-compute[75102]:   <name>instance-00000005</name>
Nov 10 16:16:30 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:16:30 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:16:30 user nova-compute[75102]:   <metadata>
Nov 10 16:16:30 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:16:30 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:16:30 user nova-compute[75102]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-908239677</nova:name>
Nov 10 16:16:30 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:16:30</nova:creationTime>
Nov 10 16:16:30 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:16:30 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:16:30 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:16:30 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:16:30 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:16:30 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:16:30 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:16:30 user nova-compute[75102]:       <nova:owner>
Nov 10 16:16:30 user nova-compute[75102]:         <nova:user uuid="b1899a5a4fd34eff90dfe1e462e3ac9c">tempest-VolumesAssistedSnapshotsTest-725875834-project-member</nova:user>
Nov 10 16:16:30 user nova-compute[75102]:         <nova:project uuid="0ee93b8e5c4a41f6bf60c6b1e8b2f481">tempest-VolumesAssistedSnapshotsTest-725875834</nova:project>
Nov 10 16:16:30 user nova-compute[75102]:       </nova:owner>
Nov 10 16:16:30 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:16:30 user nova-compute[75102]:       <nova:ports>
Nov 10 16:16:30 user nova-compute[75102]:         <nova:port uuid="d9965142-35ab-44e0-82bc-b3e8099c58ad">
Nov 10 16:16:30 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 16:16:30 user nova-compute[75102]:         </nova:port>
Nov 10 16:16:30 user nova-compute[75102]:       </nova:ports>
Nov 10 16:16:30 user nova-compute[75102]:     </nova:instance>
Nov 10 16:16:30 user nova-compute[75102]:   </metadata>
Nov 10 16:16:30 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:16:30 user nova-compute[75102]:     <system>
Nov 10 16:16:30 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:16:30 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:16:30 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:16:30 user nova-compute[75102]:       <entry name="serial">83ad82f3-4e34-46fd-94a6-71adb8884eda</entry>
Nov 10 16:16:30 user nova-compute[75102]:       <entry name="uuid">83ad82f3-4e34-46fd-94a6-71adb8884eda</entry>
Nov 10 16:16:30 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:16:30 user nova-compute[75102]:     </system>
Nov 10 16:16:30 user nova-compute[75102]:   </sysinfo>
Nov 10 16:16:30 user nova-compute[75102]:   <os>
Nov 10 16:16:30 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:16:30 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:16:30 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:16:30 user nova-compute[75102]:   </os>
Nov 10 16:16:30 user nova-compute[75102]:   <features>
Nov 10 16:16:30 user nova-compute[75102]:     <acpi/>
Nov 10 16:16:30 user nova-compute[75102]:     <apic/>
Nov 10 16:16:30 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:16:30 user nova-compute[75102]:   </features>
Nov 10 16:16:30 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:16:30 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:16:30 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:16:30 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:16:30 user nova-compute[75102]:   </clock>
Nov 10 16:16:30 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:16:30 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:16:30 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:16:30 user nova-compute[75102]:   </cpu>
Nov 10 16:16:30 user nova-compute[75102]:   <devices>
Nov 10 16:16:30 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:16:30 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:16:30 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk"/>
Nov 10 16:16:30 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:16:30 user nova-compute[75102]:     </disk>
Nov 10 16:16:30 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:16:30 user nova-compute[75102]:       <mac address="fa:16:3e:05:fa:9a"/>
Nov 10 16:16:30 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:30 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:16:30 user nova-compute[75102]:       <target dev="tapd9965142-35"/>
Nov 10 16:16:30 user nova-compute[75102]:     </interface>
Nov 10 16:16:30 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:16:30 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/console.log" append="off"/>
Nov 10 16:16:30 user nova-compute[75102]:     </serial>
Nov 10 16:16:30 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:16:30 user nova-compute[75102]:     <video>
Nov 10 16:16:30 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:30 user nova-compute[75102]:     </video>
Nov 10 16:16:30 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:16:30 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:16:30 user nova-compute[75102]:     </rng>
Nov 10 16:16:30 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:16:30 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:16:30 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:16:30 user nova-compute[75102]:     </memballoon>
Nov 10 16:16:30 user nova-compute[75102]:   </devices>
Nov 10 16:16:30 user nova-compute[75102]: </domain>
Nov 10 16:16:30 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-908239677',display_name='tempest-VolumesAssistedSnapshotsTest-server-908239677',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-908239677',id=5,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTXCDjnhkUxFfKOhd5giJVqvsNp9rhiLlvtXOgpcbhyMOC7DZIwLO/Ju71GBvfWBmAHdOYb3UzJ4VZhhSdXi1NYqROmv3YiPKSGThT9p9tqcQz8sd4YulkrZS5RqL9S6Q==',key_name='tempest-keypair-1951149358',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0ee93b8e5c4a41f6bf60c6b1e8b2f481',ramdisk_id='',reservation_id='r-iu81dcoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-725875834',owner_user_name='tempest-VolumesAssistedSnapshotsTest-725875834-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:16:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1899a5a4fd34eff90dfe1e462e3ac9c',uuid=83ad82f3-4e34-46fd-94a6-71adb8884eda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Converting VIF {"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:05:fa:9a,bridge_name='br-int',has_traffic_filtering=True,id=d9965142-35ab-44e0-82bc-b3e8099c58ad,network=Network(eee502f0-b9d7-4872-b58d-927cfbaa1b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9965142-35') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG os_vif [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:fa:9a,bridge_name='br-int',has_traffic_filtering=True,id=d9965142-35ab-44e0-82bc-b3e8099c58ad,network=Network(eee502f0-b9d7-4872-b58d-927cfbaa1b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9965142-35') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3148cc22-9d2d-55c7-be79-14439e39a6c4', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd9965142-35, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd9965142-35, col_values=(('qos', UUID('3a13300c-b31b-4100-9fea-adbb66001ef0')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd9965142-35, col_values=(('external_ids', {'iface-id': 'd9965142-35ab-44e0-82bc-b3e8099c58ad', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:05:fa:9a', 'vm-uuid': '83ad82f3-4e34-46fd-94a6-71adb8884eda'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:30 user nova-compute[75102]: INFO os_vif [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:05:fa:9a,bridge_name='br-int',has_traffic_filtering=True,id=d9965142-35ab-44e0-82bc-b3e8099c58ad,network=Network(eee502f0-b9d7-4872-b58d-927cfbaa1b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9965142-35')
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] No VIF found with MAC fa:16:3e:05:fa:9a, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.network.neutron [req-e2a418fe-bcf7-4528-a981-10600d74ac4d req-583467e6-c2a1-4a2b-8996-3dcae82d6e15 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Updated VIF entry in instance network info cache for port d9965142-35ab-44e0-82bc-b3e8099c58ad. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG nova.network.neutron [req-e2a418fe-bcf7-4528-a981-10600d74ac4d req-583467e6-c2a1-4a2b-8996-3dcae82d6e15 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Updating instance_info_cache with network_info: [{"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e2a418fe-bcf7-4528-a981-10600d74ac4d req-583467e6-c2a1-4a2b-8996-3dcae82d6e15 service nova] Releasing lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:16:32 user nova-compute[75102]: INFO nova.compute.claims [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Claim successful on node user
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-387da4b2-97c1-443d-a646-16dce34c0679 req-bd64f7a6-cce1-4605-b1b7-51cec4537663 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received event network-vif-plugged-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-387da4b2-97c1-443d-a646-16dce34c0679 req-bd64f7a6-cce1-4605-b1b7-51cec4537663 service nova] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-387da4b2-97c1-443d-a646-16dce34c0679 req-bd64f7a6-cce1-4605-b1b7-51cec4537663 service nova] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-387da4b2-97c1-443d-a646-16dce34c0679 req-bd64f7a6-cce1-4605-b1b7-51cec4537663 service nova] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-387da4b2-97c1-443d-a646-16dce34c0679 req-bd64f7a6-cce1-4605-b1b7-51cec4537663 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] No waiting events found dispatching network-vif-plugged-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:32 user nova-compute[75102]: WARNING nova.compute.manager [req-387da4b2-97c1-443d-a646-16dce34c0679 req-bd64f7a6-cce1-4605-b1b7-51cec4537663 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received unexpected event network-vif-plugged-d9965142-35ab-44e0-82bc-b3e8099c58ad for instance with vm_state building and task_state spawning.
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.567s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:16:32 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG nova.policy [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3feb9b9df3e4b80ae23321c15848efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941ab220f5014f92940dc69ff115395d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:16:33 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Creating image(s)
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.058s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.238s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.227s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk 1073741824" returned: 0 in 0.079s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.312s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Successfully created port: 85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:16:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Cannot resize image /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Ensure instance console log exists: /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-1041c1f2-5e97-4f6a-bacb-32608d006983 req-8826f9cb-22fb-413d-9cf2-ba7115b6ab1f service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received event network-vif-plugged-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1041c1f2-5e97-4f6a-bacb-32608d006983 req-8826f9cb-22fb-413d-9cf2-ba7115b6ab1f service nova] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1041c1f2-5e97-4f6a-bacb-32608d006983 req-8826f9cb-22fb-413d-9cf2-ba7115b6ab1f service nova] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1041c1f2-5e97-4f6a-bacb-32608d006983 req-8826f9cb-22fb-413d-9cf2-ba7115b6ab1f service nova] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-1041c1f2-5e97-4f6a-bacb-32608d006983 req-8826f9cb-22fb-413d-9cf2-ba7115b6ab1f service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] No waiting events found dispatching network-vif-plugged-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:34 user nova-compute[75102]: WARNING nova.compute.manager [req-1041c1f2-5e97-4f6a-bacb-32608d006983 req-8826f9cb-22fb-413d-9cf2-ba7115b6ab1f service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received unexpected event network-vif-plugged-d9965142-35ab-44e0-82bc-b3e8099c58ad for instance with vm_state building and task_state spawning.
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:16:34 user nova-compute[75102]: INFO nova.compute.claims [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Claim successful on node user
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Successfully updated port: 85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:16:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Instance spawned successfully.
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquired lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-c96b6f9f-19dc-41f3-80e0-2c8662c5ab97 req-d0393a1a-b856-42e7-9efa-9b220d743c57 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-changed-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-c96b6f9f-19dc-41f3-80e0-2c8662c5ab97 req-d0393a1a-b856-42e7-9efa-9b220d743c57 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Refreshing instance network info cache due to event network-changed-85ff080c-d374-4dde-aec4-b0dbd4b835b0. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c96b6f9f-19dc-41f3-80e0-2c8662c5ab97 req-d0393a1a-b856-42e7-9efa-9b220d743c57 service nova] Acquiring lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:16:34 user nova-compute[75102]: INFO nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Took 6.81 seconds to spawn the instance on the hypervisor.
Nov 10 16:16:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:16:35 user nova-compute[75102]: INFO nova.compute.manager [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Took 7.77 seconds to build instance.
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.507s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-da4ae74f-91f8-4c2b-a026-a0a0dfb3c94b tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.975s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updating instance_info_cache with network_info: [{"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Releasing lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Instance network_info: |[{"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c96b6f9f-19dc-41f3-80e0-2c8662c5ab97 req-d0393a1a-b856-42e7-9efa-9b220d743c57 service nova] Acquired lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.network.neutron [req-c96b6f9f-19dc-41f3-80e0-2c8662c5ab97 req-d0393a1a-b856-42e7-9efa-9b220d743c57 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Refreshing network info cache for port 85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Start _get_guest_xml network_info=[{"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:16:35 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:35 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:16:35 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13933405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13933405',id=6,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+qq64H5Vbjx8Inx+6yEga0vLwbJNL0epCbJdKi3Gom0oTPj8h30FZ5w3N1JQxqZvcLGfPUVHHvK4qcUmB4N/TDmyU59bYy0FuC/NEh/MF4Ce92Mb5OlPfx9teriOA4hQ==',key_name='tempest-keypair-1570286825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941ab220f5014f92940dc69ff115395d',ramdisk_id='',reservation_id='r-0ilj5ijd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-777879608',owner_user_name='tempest-TaggedAttachmentsTest-777879608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:16:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3feb9b9df3e4b80ae23321c15848efa',uuid=73ffbf3a-c989-4165-b886-9b5b6ca94e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converting VIF {"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=85ff080c-d374-4dde-aec4-b0dbd4b835b0,network=Network(4262c76e-72f1-4a99-a604-f4ef12aff5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ff080c-d3') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.objects.instance [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lazy-loading 'pci_devices' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:16:35 user nova-compute[75102]:   <uuid>73ffbf3a-c989-4165-b886-9b5b6ca94e90</uuid>
Nov 10 16:16:35 user nova-compute[75102]:   <name>instance-00000006</name>
Nov 10 16:16:35 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:16:35 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:16:35 user nova-compute[75102]:   <metadata>
Nov 10 16:16:35 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:16:35 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:16:35 user nova-compute[75102]:       <nova:name>tempest-device-tagging-server-13933405</nova:name>
Nov 10 16:16:35 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:16:35</nova:creationTime>
Nov 10 16:16:35 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:16:35 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:16:35 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:16:35 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:16:35 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:16:35 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:16:35 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:16:35 user nova-compute[75102]:       <nova:owner>
Nov 10 16:16:35 user nova-compute[75102]:         <nova:user uuid="c3feb9b9df3e4b80ae23321c15848efa">tempest-TaggedAttachmentsTest-777879608-project-member</nova:user>
Nov 10 16:16:35 user nova-compute[75102]:         <nova:project uuid="941ab220f5014f92940dc69ff115395d">tempest-TaggedAttachmentsTest-777879608</nova:project>
Nov 10 16:16:35 user nova-compute[75102]:       </nova:owner>
Nov 10 16:16:35 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:16:35 user nova-compute[75102]:       <nova:ports>
Nov 10 16:16:35 user nova-compute[75102]:         <nova:port uuid="85ff080c-d374-4dde-aec4-b0dbd4b835b0">
Nov 10 16:16:35 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:16:35 user nova-compute[75102]:         </nova:port>
Nov 10 16:16:35 user nova-compute[75102]:       </nova:ports>
Nov 10 16:16:35 user nova-compute[75102]:     </nova:instance>
Nov 10 16:16:35 user nova-compute[75102]:   </metadata>
Nov 10 16:16:35 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:16:35 user nova-compute[75102]:     <system>
Nov 10 16:16:35 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:16:35 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:16:35 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:16:35 user nova-compute[75102]:       <entry name="serial">73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:16:35 user nova-compute[75102]:       <entry name="uuid">73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:16:35 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:16:35 user nova-compute[75102]:     </system>
Nov 10 16:16:35 user nova-compute[75102]:   </sysinfo>
Nov 10 16:16:35 user nova-compute[75102]:   <os>
Nov 10 16:16:35 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:16:35 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:16:35 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:16:35 user nova-compute[75102]:   </os>
Nov 10 16:16:35 user nova-compute[75102]:   <features>
Nov 10 16:16:35 user nova-compute[75102]:     <acpi/>
Nov 10 16:16:35 user nova-compute[75102]:     <apic/>
Nov 10 16:16:35 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:16:35 user nova-compute[75102]:   </features>
Nov 10 16:16:35 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:16:35 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:16:35 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:16:35 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:16:35 user nova-compute[75102]:   </clock>
Nov 10 16:16:35 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:16:35 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:16:35 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:16:35 user nova-compute[75102]:   </cpu>
Nov 10 16:16:35 user nova-compute[75102]:   <devices>
Nov 10 16:16:35 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:16:35 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:16:35 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk"/>
Nov 10 16:16:35 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:16:35 user nova-compute[75102]:     </disk>
Nov 10 16:16:35 user nova-compute[75102]:     <disk type="file" device="cdrom">
Nov 10 16:16:35 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 16:16:35 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.config"/>
Nov 10 16:16:35 user nova-compute[75102]:       <target dev="hda" bus="ide"/>
Nov 10 16:16:35 user nova-compute[75102]:     </disk>
Nov 10 16:16:35 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:16:35 user nova-compute[75102]:       <mac address="fa:16:3e:e7:33:d1"/>
Nov 10 16:16:35 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:35 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:16:35 user nova-compute[75102]:       <target dev="tap85ff080c-d3"/>
Nov 10 16:16:35 user nova-compute[75102]:     </interface>
Nov 10 16:16:35 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:16:35 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log" append="off"/>
Nov 10 16:16:35 user nova-compute[75102]:     </serial>
Nov 10 16:16:35 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:16:35 user nova-compute[75102]:     <video>
Nov 10 16:16:35 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:35 user nova-compute[75102]:     </video>
Nov 10 16:16:35 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:16:35 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:16:35 user nova-compute[75102]:     </rng>
Nov 10 16:16:35 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:16:35 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:16:35 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:16:35 user nova-compute[75102]:     </memballoon>
Nov 10 16:16:35 user nova-compute[75102]:   </devices>
Nov 10 16:16:35 user nova-compute[75102]: </domain>
Nov 10 16:16:35 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13933405',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13933405',id=6,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+qq64H5Vbjx8Inx+6yEga0vLwbJNL0epCbJdKi3Gom0oTPj8h30FZ5w3N1JQxqZvcLGfPUVHHvK4qcUmB4N/TDmyU59bYy0FuC/NEh/MF4Ce92Mb5OlPfx9teriOA4hQ==',key_name='tempest-keypair-1570286825',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='941ab220f5014f92940dc69ff115395d',ramdisk_id='',reservation_id='r-0ilj5ijd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-777879608',owner_user_name='tempest-TaggedAttachmentsTest-777879608-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:16:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3feb9b9df3e4b80ae23321c15848efa',uuid=73ffbf3a-c989-4165-b886-9b5b6ca94e90,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converting VIF {"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=85ff080c-d374-4dde-aec4-b0dbd4b835b0,network=Network(4262c76e-72f1-4a99-a604-f4ef12aff5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ff080c-d3') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG os_vif [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=85ff080c-d374-4dde-aec4-b0dbd4b835b0,network=Network(4262c76e-72f1-4a99-a604-f4ef12aff5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ff080c-d3') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80827303-bf7d-5216-9080-c68bf75bbca4', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85ff080c-d3, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85ff080c-d3, col_values=(('qos', UUID('16a4ce28-2272-4e46-a1a4-5e83c3530d57')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85ff080c-d3, col_values=(('external_ids', {'iface-id': '85ff080c-d374-4dde-aec4-b0dbd4b835b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:33:d1', 'vm-uuid': '73ffbf3a-c989-4165-b886-9b5b6ca94e90'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:35 user nova-compute[75102]: INFO os_vif [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=85ff080c-d374-4dde-aec4-b0dbd4b835b0,network=Network(4262c76e-72f1-4a99-a604-f4ef12aff5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ff080c-d3')
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.policy [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '91575e6a998146d4a515f27d998f84c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f6afcc5c81124bfcbba292d2d765eeba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] No BDM found with device name hda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] No VIF found with MAC fa:16:3e:e7:33:d1, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:16:35 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Using config drive
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:16:35 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Creating image(s)
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "/opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "/opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "/opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:35 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Creating config drive at /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.config
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwn2yqwf4 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpwn2yqwf4" returned: 0 in 0.101s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.network.neutron [req-c96b6f9f-19dc-41f3-80e0-2c8662c5ab97 req-d0393a1a-b856-42e7-9efa-9b220d743c57 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updated VIF entry in instance network info cache for port 85ff080c-d374-4dde-aec4-b0dbd4b835b0. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG nova.network.neutron [req-c96b6f9f-19dc-41f3-80e0-2c8662c5ab97 req-d0393a1a-b856-42e7-9efa-9b220d743c57 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updating instance_info_cache with network_info: [{"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c96b6f9f-19dc-41f3-80e0-2c8662c5ab97 req-d0393a1a-b856-42e7-9efa-9b220d743c57 service nova] Releasing lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk 1073741824" returned: 0 in 0.115s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.273s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Successfully created port: f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Cannot resize image /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Ensure instance console log exists: /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-a31fc699-f2ed-42e9-8eac-bb250365182e req-8606a75f-70aa-421c-8f01-acc8073e0233 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a31fc699-f2ed-42e9-8eac-bb250365182e req-8606a75f-70aa-421c-8f01-acc8073e0233 service nova] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a31fc699-f2ed-42e9-8eac-bb250365182e req-8606a75f-70aa-421c-8f01-acc8073e0233 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a31fc699-f2ed-42e9-8eac-bb250365182e req-8606a75f-70aa-421c-8f01-acc8073e0233 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-a31fc699-f2ed-42e9-8eac-bb250365182e req-8606a75f-70aa-421c-8f01-acc8073e0233 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] No waiting events found dispatching network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:36 user nova-compute[75102]: WARNING nova.compute.manager [req-a31fc699-f2ed-42e9-8eac-bb250365182e req-8606a75f-70aa-421c-8f01-acc8073e0233 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received unexpected event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 for instance with vm_state active and task_state None.
Nov 10 16:16:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Successfully updated port: f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquired lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-c9408dad-3e6d-4e4b-86b4-32ab8d375d99 req-2ade9f24-1813-485d-abdd-fbc007be86cb service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-plugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c9408dad-3e6d-4e4b-86b4-32ab8d375d99 req-2ade9f24-1813-485d-abdd-fbc007be86cb service nova] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c9408dad-3e6d-4e4b-86b4-32ab8d375d99 req-2ade9f24-1813-485d-abdd-fbc007be86cb service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c9408dad-3e6d-4e4b-86b4-32ab8d375d99 req-2ade9f24-1813-485d-abdd-fbc007be86cb service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-c9408dad-3e6d-4e4b-86b4-32ab8d375d99 req-2ade9f24-1813-485d-abdd-fbc007be86cb service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] No waiting events found dispatching network-vif-plugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:37 user nova-compute[75102]: WARNING nova.compute.manager [req-c9408dad-3e6d-4e4b-86b4-32ab8d375d99 req-2ade9f24-1813-485d-abdd-fbc007be86cb service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received unexpected event network-vif-plugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 for instance with vm_state building and task_state spawning.
Nov 10 16:16:37 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updating instance_info_cache with network_info: [{"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Releasing lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Instance network_info: |[{"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Start _get_guest_xml network_info=[{"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:16:38 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:38 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1459758593',display_name='tempest-TestVolumeSwap-server-1459758593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1459758593',id=7,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFoncbm4njaCSeb79evVeqPNayXtMyAbOUr87JrVrJLcuEgCtFE1K2Bibbvt5ZjFomeNndGErc/6RtKWzQMRv/iC2uIt0X6/AcG6F8NQGhEeB4ZXkIqM9qZZrv06yQpzQ==',key_name='tempest-keypair-367958429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6afcc5c81124bfcbba292d2d765eeba',ramdisk_id='',reservation_id='r-uvtku4py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1610141871',owner_user_name='tempest-TestVolumeSwap-1610141871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91575e6a998146d4a515f27d998f84c9',uuid=ab373f84-9ba6-4336-bca7-602464b61fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Converting VIF {"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=f1e845fa-5065-4ed4-a571-28b2772e65fa,network=Network(1d0b336a-fb58-4c59-8ccc-685737dcff4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e845fa-50') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.objects.instance [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lazy-loading 'pci_devices' on Instance uuid ab373f84-9ba6-4336-bca7-602464b61fb3 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:16:38 user nova-compute[75102]:   <uuid>ab373f84-9ba6-4336-bca7-602464b61fb3</uuid>
Nov 10 16:16:38 user nova-compute[75102]:   <name>instance-00000007</name>
Nov 10 16:16:38 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:16:38 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:16:38 user nova-compute[75102]:   <metadata>
Nov 10 16:16:38 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:16:38 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:16:38 user nova-compute[75102]:       <nova:name>tempest-TestVolumeSwap-server-1459758593</nova:name>
Nov 10 16:16:38 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:16:38</nova:creationTime>
Nov 10 16:16:38 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:16:38 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:16:38 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:16:38 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:16:38 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:16:38 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:16:38 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:16:38 user nova-compute[75102]:       <nova:owner>
Nov 10 16:16:38 user nova-compute[75102]:         <nova:user uuid="91575e6a998146d4a515f27d998f84c9">tempest-TestVolumeSwap-1610141871-project-member</nova:user>
Nov 10 16:16:38 user nova-compute[75102]:         <nova:project uuid="f6afcc5c81124bfcbba292d2d765eeba">tempest-TestVolumeSwap-1610141871</nova:project>
Nov 10 16:16:38 user nova-compute[75102]:       </nova:owner>
Nov 10 16:16:38 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:16:38 user nova-compute[75102]:       <nova:ports>
Nov 10 16:16:38 user nova-compute[75102]:         <nova:port uuid="f1e845fa-5065-4ed4-a571-28b2772e65fa">
Nov 10 16:16:38 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 16:16:38 user nova-compute[75102]:         </nova:port>
Nov 10 16:16:38 user nova-compute[75102]:       </nova:ports>
Nov 10 16:16:38 user nova-compute[75102]:     </nova:instance>
Nov 10 16:16:38 user nova-compute[75102]:   </metadata>
Nov 10 16:16:38 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:16:38 user nova-compute[75102]:     <system>
Nov 10 16:16:38 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:16:38 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:16:38 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:16:38 user nova-compute[75102]:       <entry name="serial">ab373f84-9ba6-4336-bca7-602464b61fb3</entry>
Nov 10 16:16:38 user nova-compute[75102]:       <entry name="uuid">ab373f84-9ba6-4336-bca7-602464b61fb3</entry>
Nov 10 16:16:38 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:16:38 user nova-compute[75102]:     </system>
Nov 10 16:16:38 user nova-compute[75102]:   </sysinfo>
Nov 10 16:16:38 user nova-compute[75102]:   <os>
Nov 10 16:16:38 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:16:38 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:16:38 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:16:38 user nova-compute[75102]:   </os>
Nov 10 16:16:38 user nova-compute[75102]:   <features>
Nov 10 16:16:38 user nova-compute[75102]:     <acpi/>
Nov 10 16:16:38 user nova-compute[75102]:     <apic/>
Nov 10 16:16:38 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:16:38 user nova-compute[75102]:   </features>
Nov 10 16:16:38 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:16:38 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:16:38 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:16:38 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:16:38 user nova-compute[75102]:   </clock>
Nov 10 16:16:38 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:16:38 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:16:38 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:16:38 user nova-compute[75102]:   </cpu>
Nov 10 16:16:38 user nova-compute[75102]:   <devices>
Nov 10 16:16:38 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:16:38 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:16:38 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk"/>
Nov 10 16:16:38 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:16:38 user nova-compute[75102]:     </disk>
Nov 10 16:16:38 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:16:38 user nova-compute[75102]:       <mac address="fa:16:3e:c5:fc:2c"/>
Nov 10 16:16:38 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:38 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:16:38 user nova-compute[75102]:       <target dev="tapf1e845fa-50"/>
Nov 10 16:16:38 user nova-compute[75102]:     </interface>
Nov 10 16:16:38 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:16:38 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/console.log" append="off"/>
Nov 10 16:16:38 user nova-compute[75102]:     </serial>
Nov 10 16:16:38 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:16:38 user nova-compute[75102]:     <video>
Nov 10 16:16:38 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:16:38 user nova-compute[75102]:     </video>
Nov 10 16:16:38 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:16:38 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:16:38 user nova-compute[75102]:     </rng>
Nov 10 16:16:38 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:16:38 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:16:38 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:16:38 user nova-compute[75102]:     </memballoon>
Nov 10 16:16:38 user nova-compute[75102]:   </devices>
Nov 10 16:16:38 user nova-compute[75102]: </domain>
Nov 10 16:16:38 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1459758593',display_name='tempest-TestVolumeSwap-server-1459758593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1459758593',id=7,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFoncbm4njaCSeb79evVeqPNayXtMyAbOUr87JrVrJLcuEgCtFE1K2Bibbvt5ZjFomeNndGErc/6RtKWzQMRv/iC2uIt0X6/AcG6F8NQGhEeB4ZXkIqM9qZZrv06yQpzQ==',key_name='tempest-keypair-367958429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f6afcc5c81124bfcbba292d2d765eeba',ramdisk_id='',reservation_id='r-uvtku4py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1610141871',owner_user_name='tempest-TestVolumeSwap-1610141871-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91575e6a998146d4a515f27d998f84c9',uuid=ab373f84-9ba6-4336-bca7-602464b61fb3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Converting VIF {"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=f1e845fa-5065-4ed4-a571-28b2772e65fa,network=Network(1d0b336a-fb58-4c59-8ccc-685737dcff4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e845fa-50') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG os_vif [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=f1e845fa-5065-4ed4-a571-28b2772e65fa,network=Network(1d0b336a-fb58-4c59-8ccc-685737dcff4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e845fa-50') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ed34cf03-aebf-5dd9-b8b5-78db0335c7fa', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf1e845fa-50, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf1e845fa-50, col_values=(('qos', UUID('e526b04f-c0dd-4fe0-b0b1-d5b994047ea4')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf1e845fa-50, col_values=(('external_ids', {'iface-id': 'f1e845fa-5065-4ed4-a571-28b2772e65fa', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:fc:2c', 'vm-uuid': 'ab373f84-9ba6-4336-bca7-602464b61fb3'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: INFO os_vif [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=f1e845fa-5065-4ed4-a571-28b2772e65fa,network=Network(1d0b336a-fb58-4c59-8ccc-685737dcff4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e845fa-50')
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] No VIF found with MAC fa:16:3e:c5:fc:2c, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] No waiting events found dispatching network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:38 user nova-compute[75102]: WARNING nova.compute.manager [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received unexpected event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 for instance with vm_state active and task_state None.
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received event network-changed-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Refreshing instance network info cache due to event network-changed-f1e845fa-5065-4ed4-a571-28b2772e65fa. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] Acquiring lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] Acquired lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:38 user nova-compute[75102]: DEBUG nova.network.neutron [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Refreshing network info cache for port f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:16:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updated VIF entry in instance network info cache for port f1e845fa-5065-4ed4-a571-28b2772e65fa. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:16:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updating instance_info_cache with network_info: [{"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b7265fde-2c12-47cf-ac5f-140e72de84c2 req-83f2c262-c4e7-4345-b085-13b347791e31 service nova] Releasing lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-1aa4f88a-f383-4f9c-bbba-e9294dc8465a req-7541a49f-a4e2-4bd8-92e0-bf1dfe199ddd service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-plugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1aa4f88a-f383-4f9c-bbba-e9294dc8465a req-7541a49f-a4e2-4bd8-92e0-bf1dfe199ddd service nova] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1aa4f88a-f383-4f9c-bbba-e9294dc8465a req-7541a49f-a4e2-4bd8-92e0-bf1dfe199ddd service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1aa4f88a-f383-4f9c-bbba-e9294dc8465a req-7541a49f-a4e2-4bd8-92e0-bf1dfe199ddd service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-1aa4f88a-f383-4f9c-bbba-e9294dc8465a req-7541a49f-a4e2-4bd8-92e0-bf1dfe199ddd service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] No waiting events found dispatching network-vif-plugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:39 user nova-compute[75102]: WARNING nova.compute.manager [req-1aa4f88a-f383-4f9c-bbba-e9294dc8465a req-7541a49f-a4e2-4bd8-92e0-bf1dfe199ddd service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received unexpected event network-vif-plugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 for instance with vm_state building and task_state spawning.
Nov 10 16:16:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:16:40 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Instance spawned successfully.
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:40 user nova-compute[75102]: INFO nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 10 16:16:40 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:16:40 user nova-compute[75102]: INFO nova.compute.manager [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Took 8.41 seconds to build instance.
Nov 10 16:16:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0db70e28-ca58-4d39-903f-3f7e74e70c98 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.571s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received event network-vif-plugged-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] No waiting events found dispatching network-vif-plugged-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:41 user nova-compute[75102]: WARNING nova.compute.manager [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received unexpected event network-vif-plugged-f1e845fa-5065-4ed4-a571-28b2772e65fa for instance with vm_state building and task_state spawning.
Nov 10 16:16:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received event network-vif-plugged-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] No waiting events found dispatching network-vif-plugged-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:16:41 user nova-compute[75102]: WARNING nova.compute.manager [req-6c236897-a324-4d26-94f7-3fde2788f17f req-6027269a-7708-4667-84a5-702a7906fa53 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received unexpected event network-vif-plugged-f1e845fa-5065-4ed4-a571-28b2772e65fa for instance with vm_state building and task_state spawning.
Nov 10 16:16:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:16:42 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Instance spawned successfully.
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:16:42 user nova-compute[75102]: INFO nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Took 7.28 seconds to spawn the instance on the hypervisor.
Nov 10 16:16:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:16:42 user nova-compute[75102]: INFO nova.compute.manager [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Took 8.38 seconds to build instance.
Nov 10 16:16:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7e497659-9b28-44eb-af1e-ee2a55d4f349 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.588s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:43 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:45 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:45 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:16:45 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:16:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-e7db38aa-7e5d-4b9a-a7f4-362819172489" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:16:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-e7db38aa-7e5d-4b9a-a7f4-362819172489" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:16:45 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:16:45 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid e7db38aa-7e5d-4b9a-a7f4-362819172489 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Updating instance_info_cache with network_info: [{"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-e7db38aa-7e5d-4b9a-a7f4-362819172489" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:16:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.278s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:16:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:16:50 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:50 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8007MB free_disk=25.695331573486328GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance e7db38aa-7e5d-4b9a-a7f4-362819172489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 83ad82f3-4e34-46fd-94a6-71adb8884eda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ab373f84-9ba6-4336-bca7-602464b61fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 16:16:50 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 16:16:51 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:16:51 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:16:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:16:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.951s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:16:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:16:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:16:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:16:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "6458fc11-6612-4108-addd-ce61d935431e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:17 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:17:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:17:17 user nova-compute[75102]: INFO nova.compute.claims [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Claim successful on node user
Nov 10 16:17:18 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:17:18 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:17:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:17:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:17:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:17:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:17:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:17:18 user nova-compute[75102]: DEBUG nova.policy [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a50fb02c29f417d97115fdf45ffbcee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23ed0272e95b41a6b623002f93b1511f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:17:18 user nova-compute[75102]: INFO nova.virt.block_device [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Booting with volume aefc9e87-7a41-45fe-97a7-113f4a673159 at /dev/vda
Nov 10 16:17:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:18 user nova-compute[75102]: DEBUG os_brick.utils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:17:18 user nova-compute[75102]: INFO oslo.privsep.daemon [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpjapjgw2q/privsep.sock']
Nov 10 16:17:18 user sudo[85887]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpjapjgw2q/privsep.sock
Nov 10 16:17:18 user sudo[85887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 10 16:17:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Successfully created port: 57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:17:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Successfully updated port: 57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:17:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "refresh_cache-6458fc11-6612-4108-addd-ce61d935431e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:17:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquired lock "refresh_cache-6458fc11-6612-4108-addd-ce61d935431e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:17:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-2e2e13e6-a60a-4b43-9861-94e6a373c76f req-6c003757-c781-4c95-917a-fccf1be784db service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-changed-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-2e2e13e6-a60a-4b43-9861-94e6a373c76f req-6c003757-c781-4c95-917a-fccf1be784db service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Refreshing instance network info cache due to event network-changed-57d19842-a13a-4616-b2fd-9957fc90f7c7. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2e2e13e6-a60a-4b43-9861-94e6a373c76f req-6c003757-c781-4c95-917a-fccf1be784db service nova] Acquiring lock "refresh_cache-6458fc11-6612-4108-addd-ce61d935431e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:17:20 user sudo[85887]: pam_unix(sudo:session): session closed for user root
Nov 10 16:17:20 user nova-compute[75102]: INFO oslo.privsep.daemon [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Spawned new privsep daemon via rootwrap
Nov 10 16:17:20 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 10 16:17:20 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 10 16:17:20 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 10 16:17:20 user nova-compute[75102]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 85940
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b23acfc-82fd-48cc-892e-b684e16bbdcd]: (2,) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Updating instance_info_cache with network_info: [{"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Releasing lock "refresh_cache-6458fc11-6612-4108-addd-ce61d935431e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance network_info: |[{"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2e2e13e6-a60a-4b43-9861-94e6a373c76f req-6c003757-c781-4c95-917a-fccf1be784db service nova] Acquired lock "refresh_cache-6458fc11-6612-4108-addd-ce61d935431e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-2e2e13e6-a60a-4b43-9861-94e6a373c76f req-6c003757-c781-4c95-917a-fccf1be784db service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Refreshing network info cache for port 57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[24abb341-5f46-4da3-adc0-9210aa0bd7d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:20 user nova-compute[75102]: WARNING os_brick.initiator.connectors.nvmeof [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bde994-64e9-44bc-8113-323dfa1ec35b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd06594d-cc7b-40ee-a852-0056b648218d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fc4f2af-4bf0-4e37-80b0-c666e8cbccf2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:17:20 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a911640a-053b-483b-bbf7-4d21ff1a2188]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG os_brick.utils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] <== get_connector_properties: return (1989ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Updating existing volume attachment record: 937469fc-839c-4a16-8ed1-6c4d8d5bbaa0 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-2e2e13e6-a60a-4b43-9861-94e6a373c76f req-6c003757-c781-4c95-917a-fccf1be784db service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Updated VIF entry in instance network info cache for port 57d19842-a13a-4616-b2fd-9957fc90f7c7. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-2e2e13e6-a60a-4b43-9861-94e6a373c76f req-6c003757-c781-4c95-917a-fccf1be784db service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Updating instance_info_cache with network_info: [{"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:17:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2e2e13e6-a60a-4b43-9861-94e6a373c76f req-6c003757-c781-4c95-917a-fccf1be784db service nova] Releasing lock "refresh_cache-6458fc11-6612-4108-addd-ce61d935431e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:17:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:17:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:17:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:17:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:17:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:17:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:17:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:17:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:17:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:17:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:17:43 user nova-compute[75102]: INFO nova.compute.manager [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] instance snapshotting
Nov 10 16:17:43 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Beginning live snapshot process
Nov 10 16:17:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json -f qcow2 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json -f qcow2" returned: 0 in 0.209s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json -f qcow2 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json -f qcow2" returned: 0 in 0.218s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy_xqrzom/2d3dfe3736614018ac47d77b6c9f8175.delta 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpy_xqrzom/2d3dfe3736614018ac47d77b6c9f8175.delta 1073741824" returned: 0 in 0.059s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 16:17:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75102) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 10 16:17:44 user nova-compute[75102]: INFO nova.virt.libvirt.host [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] UEFI support detected
Nov 10 16:17:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:17:45 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Creating image(s)
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Ensure instance console log exists: /opt/stack/data/nova/instances/6458fc11-6612-4108-addd-ce61d935431e/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Start _get_guest_xml network_info=[{"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '937469fc-839c-4a16-8ed1-6c4d8d5bbaa0', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMVPuJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6458fc11-6612-4108-addd-ce61d935431e', 'attached_at': '', 'detached_at': '', 'volume_id': 'aefc9e87-7a41-45fe-97a7-113f4a673159', 'serial': 'aefc9e87-7a41-45fe-97a7-113f4a673159'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:17:45 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:17:45 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connector [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Factory for ISCSI on None {{(pid=75102) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMVPuJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:17:45 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:17:45 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:17:45 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260" returned: 21 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdc8f56-409c-4abd-9407-c095e2286dcd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:17:45 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec3f0d3a-5fc6-402a-9830-2ba1485f8da3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159] added
Nov 10 16:17:45 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38db6df1-1601-4d25-aabc-7230f46e2c4d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc828f1-b971-4890-b97e-f6240322d3b5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMVPuJeX {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMVPuJeX" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9970941f-ae21-4e4c-bf03-6e753b9188cb]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMVPuJeX'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.041s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d01e0b5-2ed2-4365-b565-23f3b65f3074]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3ed911-f165-4cf4-8240-bcbd9eda44dc]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:17:45 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:17:45 user nova-compute[75102]:  {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:17:45 user nova-compute[75102]: WARNING os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 16:17:45 user nova-compute[75102]: 
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] COPY block job progress, current cursor: 26411008 final cursor: 75497472 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --login" returned: 0 in 0.101s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda1c70b-0a85-43d2-bfc1-9af918b023ad]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260]
Nov 10 16:17:45 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260] successful.
Nov 10 16:17:45 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[75f793d9-7a14-401f-8e55-fe7bd0fad812]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e994a2b-8807-420b-806a-176d2c72dfad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:17:45 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:17:45 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b75437-4f3b-4ac3-a45d-15165e04e9a2]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMVPuJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG nova.objects.instance [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lazy-loading 'flavor' on Instance uuid e7db38aa-7e5d-4b9a-a7f4-362819172489 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.137s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:45 user nova-compute[75102]: INFO nova.compute.manager [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Attaching volume cd8098b7-45ed-422e-9e0f-ee10de3b2fea to /dev/vdb
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:17:46 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 16:17:46 user nova-compute[75102]: DEBUG os_brick.utils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fef610f-a8fa-4462-8d04-4d232aa7de00]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy_xqrzom/2d3dfe3736614018ac47d77b6c9f8175.delta /opt/stack/data/nova/instances/snapshots/tmpy_xqrzom/2d3dfe3736614018ac47d77b6c9f8175 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3370f7-743b-43cc-a7ab-65843e817890]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff179e6e-8b16-42bd-9ff2-8224a74c6a26]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97a58e7-74aa-4a9e-949f-5fea5a7b86b5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updating instance_info_cache with network_info: [{"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:17:46 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eaab7a6-fa98-48fd-939e-db67d6fcc5ef]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG os_brick.utils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] <== get_connector_properties: return (210ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Updating existing volume attachment record: ec31cae9-6f80-4cbc-8710-90657a06d727 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.408s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] <== connect_volume: return (1411ms) {'type': 'block', 'scsi_wwn': '26338336531633765', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338336531633765', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-762086081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-762086081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCYcmc6fbkVb87dY5vNaRKdJPEGkW/2zIEZbxcYW56VTIvJZFnE6PxiWcAsvDS1lc7Hspn+uCDjxoiD1E6lbtqupamzWdbjY1UQdTjVnbkbvuyi/ytsTEUONZgVQW/ong==',key_name='tempest-keypair-583205912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23ed0272e95b41a6b623002f93b1511f',ramdisk_id='',reservation_id='r-wi7m0598',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-725654860',owner_user_name='tempest-ServerActionsV293TestJSON-725654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a50fb02c29f417d97115fdf45ffbcee',uuid=6458fc11-6612-4108-addd-ce61d935431e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converting VIF {"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.objects.instance [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lazy-loading 'pci_devices' on Instance uuid 6458fc11-6612-4108-addd-ce61d935431e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:17:46 user nova-compute[75102]:   <uuid>6458fc11-6612-4108-addd-ce61d935431e</uuid>
Nov 10 16:17:46 user nova-compute[75102]:   <name>instance-00000008</name>
Nov 10 16:17:46 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:17:46 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:17:46 user nova-compute[75102]:   <metadata>
Nov 10 16:17:46 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:17:46 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:17:46 user nova-compute[75102]:       <nova:name>tempest-ServerActionsV293TestJSON-server-762086081</nova:name>
Nov 10 16:17:46 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:17:45</nova:creationTime>
Nov 10 16:17:46 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:17:46 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:17:46 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:17:46 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:17:46 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:17:46 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:17:46 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:17:46 user nova-compute[75102]:       <nova:owner>
Nov 10 16:17:46 user nova-compute[75102]:         <nova:user uuid="0a50fb02c29f417d97115fdf45ffbcee">tempest-ServerActionsV293TestJSON-725654860-project-member</nova:user>
Nov 10 16:17:46 user nova-compute[75102]:         <nova:project uuid="23ed0272e95b41a6b623002f93b1511f">tempest-ServerActionsV293TestJSON-725654860</nova:project>
Nov 10 16:17:46 user nova-compute[75102]:       </nova:owner>
Nov 10 16:17:46 user nova-compute[75102]:       <nova:ports>
Nov 10 16:17:46 user nova-compute[75102]:         <nova:port uuid="57d19842-a13a-4616-b2fd-9957fc90f7c7">
Nov 10 16:17:46 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 16:17:46 user nova-compute[75102]:         </nova:port>
Nov 10 16:17:46 user nova-compute[75102]:       </nova:ports>
Nov 10 16:17:46 user nova-compute[75102]:     </nova:instance>
Nov 10 16:17:46 user nova-compute[75102]:   </metadata>
Nov 10 16:17:46 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:17:46 user nova-compute[75102]:     <system>
Nov 10 16:17:46 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:17:46 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:17:46 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:17:46 user nova-compute[75102]:       <entry name="serial">6458fc11-6612-4108-addd-ce61d935431e</entry>
Nov 10 16:17:46 user nova-compute[75102]:       <entry name="uuid">6458fc11-6612-4108-addd-ce61d935431e</entry>
Nov 10 16:17:46 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:17:46 user nova-compute[75102]:     </system>
Nov 10 16:17:46 user nova-compute[75102]:   </sysinfo>
Nov 10 16:17:46 user nova-compute[75102]:   <os>
Nov 10 16:17:46 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:17:46 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:17:46 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:17:46 user nova-compute[75102]:   </os>
Nov 10 16:17:46 user nova-compute[75102]:   <features>
Nov 10 16:17:46 user nova-compute[75102]:     <acpi/>
Nov 10 16:17:46 user nova-compute[75102]:     <apic/>
Nov 10 16:17:46 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:17:46 user nova-compute[75102]:   </features>
Nov 10 16:17:46 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:17:46 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:17:46 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:17:46 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:17:46 user nova-compute[75102]:   </clock>
Nov 10 16:17:46 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:17:46 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:17:46 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:17:46 user nova-compute[75102]:   </cpu>
Nov 10 16:17:46 user nova-compute[75102]:   <devices>
Nov 10 16:17:46 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:17:46 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:17:46 user nova-compute[75102]:       <source dev="/dev/sdb"/>
Nov 10 16:17:46 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:17:46 user nova-compute[75102]:       <serial>aefc9e87-7a41-45fe-97a7-113f4a673159</serial>
Nov 10 16:17:46 user nova-compute[75102]:     </disk>
Nov 10 16:17:46 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:17:46 user nova-compute[75102]:       <mac address="fa:16:3e:5e:42:60"/>
Nov 10 16:17:46 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:17:46 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:17:46 user nova-compute[75102]:       <target dev="tap57d19842-a1"/>
Nov 10 16:17:46 user nova-compute[75102]:     </interface>
Nov 10 16:17:46 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:17:46 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/6458fc11-6612-4108-addd-ce61d935431e/console.log" append="off"/>
Nov 10 16:17:46 user nova-compute[75102]:     </serial>
Nov 10 16:17:46 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:17:46 user nova-compute[75102]:     <video>
Nov 10 16:17:46 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:17:46 user nova-compute[75102]:     </video>
Nov 10 16:17:46 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:17:46 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:17:46 user nova-compute[75102]:     </rng>
Nov 10 16:17:46 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:17:46 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:17:46 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:17:46 user nova-compute[75102]:     </memballoon>
Nov 10 16:17:46 user nova-compute[75102]:   </devices>
Nov 10 16:17:46 user nova-compute[75102]: </domain>
Nov 10 16:17:46 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-762086081',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-762086081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCYcmc6fbkVb87dY5vNaRKdJPEGkW/2zIEZbxcYW56VTIvJZFnE6PxiWcAsvDS1lc7Hspn+uCDjxoiD1E6lbtqupamzWdbjY1UQdTjVnbkbvuyi/ytsTEUONZgVQW/ong==',key_name='tempest-keypair-583205912',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='23ed0272e95b41a6b623002f93b1511f',ramdisk_id='',reservation_id='r-wi7m0598',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-725654860',owner_user_name='tempest-ServerActionsV293TestJSON-725654860-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a50fb02c29f417d97115fdf45ffbcee',uuid=6458fc11-6612-4108-addd-ce61d935431e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converting VIF {"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG os_vif [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c11e8b0-7b51-5656-a765-df942153cadc', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57d19842-a1, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57d19842-a1, col_values=(('qos', UUID('1a9b1f26-49f9-4ded-bf59-b1cb5a2d42ec')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57d19842-a1, col_values=(('external_ids', {'iface-id': '57d19842-a13a-4616-b2fd-9957fc90f7c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:42:60', 'vm-uuid': '6458fc11-6612-4108-addd-ce61d935431e'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:46 user nova-compute[75102]: INFO os_vif [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1')
Nov 10 16:17:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpy_xqrzom/2d3dfe3736614018ac47d77b6c9f8175.delta /opt/stack/data/nova/instances/snapshots/tmpy_xqrzom/2d3dfe3736614018ac47d77b6c9f8175" returned: 0 in 0.709s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:46 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Snapshot extracted, beginning image upload
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:17:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] No VIF found with MAC fa:16:3e:5e:42:60, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:17:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:17:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-9820c5a9-30e7-443f-b2fe-352d538de7ac req-ab7298f1-50e2-48d4-90ad-2d561204512f service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9820c5a9-30e7-443f-b2fe-352d538de7ac req-ab7298f1-50e2-48d4-90ad-2d561204512f service nova] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9820c5a9-30e7-443f-b2fe-352d538de7ac req-ab7298f1-50e2-48d4-90ad-2d561204512f service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9820c5a9-30e7-443f-b2fe-352d538de7ac req-ab7298f1-50e2-48d4-90ad-2d561204512f service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-9820c5a9-30e7-443f-b2fe-352d538de7ac req-ab7298f1-50e2-48d4-90ad-2d561204512f service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] No waiting events found dispatching network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:17:49 user nova-compute[75102]: WARNING nova.compute.manager [req-9820c5a9-30e7-443f-b2fe-352d538de7ac req-ab7298f1-50e2-48d4-90ad-2d561204512f service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received unexpected event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 for instance with vm_state building and task_state spawning.
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.276s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:50 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Snapshot image upload complete
Nov 10 16:17:50 user nova-compute[75102]: INFO nova.compute.manager [None req-67ba5d4a-fd55-419b-802a-b3a1f28631e9 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Took 7.09 seconds to snapshot the instance on the hypervisor.
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:17:50 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance spawned successfully.
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:17:50 user nova-compute[75102]: INFO nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 10 16:17:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:51 user nova-compute[75102]: INFO nova.compute.manager [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Took 33.34 seconds to build instance.
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a05207d-73a8-4b8e-b3fd-7310286fe8f7 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "6458fc11-6612-4108-addd-ce61d935431e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.497s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-changed-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Refreshing instance network info cache due to event network-changed-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] Acquiring lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] Acquired lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG nova.network.neutron [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Refreshing network info cache for port 73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG nova.network.neutron [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updated VIF entry in instance network info cache for port 73a78287-ce4f-4bf1-b9aa-e5eecbc4a608. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG nova.network.neutron [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] Releasing lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] No waiting events found dispatching network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:17:51 user nova-compute[75102]: WARNING nova.compute.manager [req-ca185949-a63d-4077-817f-89a31a856988 req-44f36610-b4a1-4c3f-ab3b-88035ec8af63 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received unexpected event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 for instance with vm_state active and task_state None.
Nov 10 16:17:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:52 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:17:52 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7741MB free_disk=25.5703125GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance e7db38aa-7e5d-4b9a-a7f4-362819172489 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 83ad82f3-4e34-46fd-94a6-71adb8884eda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ab373f84-9ba6-4336-bca7-602464b61fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6458fc11-6612-4108-addd-ce61d935431e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:17:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:17:53 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:17:53 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:17:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:17:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.580s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:54 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:17:54 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:17:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:17:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:17:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:17:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:17:56 user nova-compute[75102]: INFO nova.compute.claims [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Claim successful on node user
Nov 10 16:17:57 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:17:57 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:17:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:17:57 user nova-compute[75102]: INFO nova.virt.block_device [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Booting with volume 3e4bc73d-8513-446f-ae00-b5d4b697d1da at /dev/vda
Nov 10 16:17:57 user nova-compute[75102]: DEBUG nova.policy [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7158e1b0077b4cdfaf14fe39a43fafa7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ce93c56e5e943789f4178c52523a81c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG os_brick.utils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dee556b-456b-4b18-8ca3-034bae914c07]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6af3ca31-d1a6-4a32-be67-6d7f9658d1ec]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00672c0-ff37-4f9a-8e9e-62d1e0807eb5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[171683ca-62f4-477d-b7c8-cea281ce91e4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:17:57 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:17:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[05fea7d2-6f66-4e30-bb13-787ca39ea7a0]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG os_brick.utils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:17:57 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating existing volume attachment record: d3086e27-2bef-4f1a-8031-587c013e094a {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:17:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully created port: 39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:17:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:17:59 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully created port: b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:17:59 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully created port: 03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:18:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully created port: b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:18:01 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully created port: a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:18:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:01 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully updated port: 39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:18:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-70455013-fdf4-4a7d-a4f6-09dceab44d8b req-76240ffc-ef52-476d-96eb-189bc3fdbb99 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-changed-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-70455013-fdf4-4a7d-a4f6-09dceab44d8b req-76240ffc-ef52-476d-96eb-189bc3fdbb99 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing instance network info cache due to event network-changed-39c985ac-2f47-482e-8376-5a0d6531bbd4. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-70455013-fdf4-4a7d-a4f6-09dceab44d8b req-76240ffc-ef52-476d-96eb-189bc3fdbb99 service nova] Acquiring lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-70455013-fdf4-4a7d-a4f6-09dceab44d8b req-76240ffc-ef52-476d-96eb-189bc3fdbb99 service nova] Acquired lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:02 user nova-compute[75102]: DEBUG nova.network.neutron [req-70455013-fdf4-4a7d-a4f6-09dceab44d8b req-76240ffc-ef52-476d-96eb-189bc3fdbb99 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing network info cache for port 39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:02 user nova-compute[75102]: DEBUG nova.network.neutron [req-70455013-fdf4-4a7d-a4f6-09dceab44d8b req-76240ffc-ef52-476d-96eb-189bc3fdbb99 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:18:02 user nova-compute[75102]: DEBUG nova.network.neutron [req-70455013-fdf4-4a7d-a4f6-09dceab44d8b req-76240ffc-ef52-476d-96eb-189bc3fdbb99 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-70455013-fdf4-4a7d-a4f6-09dceab44d8b req-76240ffc-ef52-476d-96eb-189bc3fdbb99 service nova] Releasing lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully updated port: 3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:18:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully updated port: ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-changed-3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing instance network info cache due to event network-changed-3158e32f-b3dc-4bbf-878e-dcb004f642a3. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] Acquiring lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] Acquired lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing network info cache for port 3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] Releasing lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-changed-ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing instance network info cache due to event network-changed-ba625408-a772-4626-82a3-b411c917d6cd. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] Acquiring lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] Acquired lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing network info cache for port ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:18:04 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully updated port: b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:18:05 user nova-compute[75102]: DEBUG nova.network.neutron [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-00eb84d7-4467-4faa-a23b-ddcbee8b6da2 req-c021db40-5632-4116-bde9-8c9fa26ef771 service nova] Releasing lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:05 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully updated port: 03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-changed-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing instance network info cache due to event network-changed-b83d6e13-aa0f-4815-8b3e-91e003b2b136. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] Acquiring lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] Acquired lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing network info cache for port b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-30d00699-187c-4f9e-9fcd-01e3943ddacb req-144d52c9-3400-4815-9e7f-65f2e9921ed1 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-changed-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-30d00699-187c-4f9e-9fcd-01e3943ddacb req-144d52c9-3400-4815-9e7f-65f2e9921ed1 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Refreshing instance network info cache due to event network-changed-d00f79b8-7518-4a77-a447-16d1ebcf0be1. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-30d00699-187c-4f9e-9fcd-01e3943ddacb req-144d52c9-3400-4815-9e7f-65f2e9921ed1 service nova] Acquiring lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-30d00699-187c-4f9e-9fcd-01e3943ddacb req-144d52c9-3400-4815-9e7f-65f2e9921ed1 service nova] Acquired lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-30d00699-187c-4f9e-9fcd-01e3943ddacb req-144d52c9-3400-4815-9e7f-65f2e9921ed1 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Refreshing network info cache for port d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] Releasing lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-changed-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing instance network info cache due to event network-changed-03e161ba-5708-40fa-96d1-895fbaf95ca3. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] Acquiring lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] Acquired lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing network info cache for port 03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully updated port: b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4c2e1fd4-40c1-4880-97e5-bf8fb27ff733 req-bdeb3972-832d-4bda-9d49-4cf727e54b01 service nova] Releasing lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-30d00699-187c-4f9e-9fcd-01e3943ddacb req-144d52c9-3400-4815-9e7f-65f2e9921ed1 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updated VIF entry in instance network info cache for port d00f79b8-7518-4a77-a447-16d1ebcf0be1. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:18:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-30d00699-187c-4f9e-9fcd-01e3943ddacb req-144d52c9-3400-4815-9e7f-65f2e9921ed1 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updating instance_info_cache with network_info: [{"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-30d00699-187c-4f9e-9fcd-01e3943ddacb req-144d52c9-3400-4815-9e7f-65f2e9921ed1 service nova] Releasing lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:08 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Successfully updated port: a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:18:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquired lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:08 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:18:08 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:18:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-changed-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing instance network info cache due to event network-changed-b4412faa-9961-4fa7-9993-76a00afbe6b6. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] Acquiring lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [{"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Releasing lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance network_info: |[{"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] Acquired lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing network info cache for port b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updated VIF entry in instance network info cache for port b4412faa-9961-4fa7-9993-76a00afbe6b6. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [{"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] Releasing lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-changed-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing instance network info cache due to event network-changed-a0215f7d-3a99-4c69-af70-d886b84dcc36. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] Acquiring lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] Acquired lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing network info cache for port a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updated VIF entry in instance network info cache for port a0215f7d-3a99-4c69-af70-d886b84dcc36. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:18:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [{"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b4657fa-469c-4e9b-b3a3-571fd21d538d req-8f66d465-37f5-4bb1-aedb-d35d264fa9b9 service nova] Releasing lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmJtqGrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:18:15 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:18:15 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:18:15 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[55249251-7d99-4fc9-b826-c9429b5daa9e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:18:15 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lazy-loading 'flavor' on Instance uuid cc9e365b-8b0a-40db-bbc4-026f609cdd7a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fd3667-bdb6-419c-bbdd-17914783d541]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea] added
Nov 10 16:18:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bbb426-1208-4f62-98b4-5a84e3556922]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0e86b3-a398-4b35-b95b-b48faa8bd350]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.094s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmJtqGrX {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AmJtqGrX" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7204236f-56a3-402b-9c4a-02e75957eba7]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AmJtqGrX'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8f1e2f3-b796-47ad-9b88-22494a695be6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ad8a7d4-7767-4259-8e9f-9c4feacaea7d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:18:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:18:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[888873a9-8571-490c-9620-9b8c1c53c95f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea, portal: 172.16.0.220,3260]
Nov 10 16:18:15 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea, portal: 172.16.0.220,3260] successful.
Nov 10 16:18:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[13e10b29-ad0e-4036-81da-c3644db9e4fa]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b427a73f-3142-4d79-823b-676ad214ba95]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:18:15 user nova-compute[75102]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea (non-flash)
Nov 10 16:18:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:18:15 user nova-compute[75102]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea (non-flash)
Nov 10 16:18:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd24e705-e799-401a-ac71-e62b8a28e560]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmJtqGrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:15 user nova-compute[75102]: INFO nova.compute.manager [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Attaching volume b6bcba7a-cd67-4243-87fd-4fa95722e753 to /dev/sdc
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.utils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6720ccf-c1f8-4164-a737-cf57770ad680]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec8b258-8f07-48ee-a0a7-83f51bc824b2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef8f2e6-da98-4913-943c-e537acd32e70]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[068e7781-f0be-42ce-9715-c9b9055d3a58]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:15 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:18:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adc74b8-117c-4342-aefd-33c76cd4c1db]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG os_brick.utils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:18:15 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updating existing volume attachment record: 62cc6ef5-0671-413a-b61e-f8f334c6ea7b {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:18:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:18:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23466646332616237', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:18:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466646332616237', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:18:16 user nova-compute[75102]: DEBUG nova.objects.instance [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lazy-loading 'flavor' on Instance uuid e7db38aa-7e5d-4b9a-a7f4-362819172489 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:18:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:18:16 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:18:16 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:18:16 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:18:16 user nova-compute[75102]:   <serial>cd8098b7-45ed-422e-9e0f-ee10de3b2fea</serial>
Nov 10 16:18:16 user nova-compute[75102]: </disk>
Nov 10 16:18:16 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:18:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:18:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:18:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] No VIF found with MAC fa:16:3e:06:5c:a8, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:18:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-061ffe3d-20b0-458e-8f2d-5a3b43500bdf tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.127s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-99e3c4ab-873c-40ae-be40-b8addab28257 req-95c256fc-6491-4878-a5ff-ed27c3f67c8f service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received event network-changed-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-99e3c4ab-873c-40ae-be40-b8addab28257 req-95c256fc-6491-4878-a5ff-ed27c3f67c8f service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Refreshing instance network info cache due to event network-changed-d9965142-35ab-44e0-82bc-b3e8099c58ad. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-99e3c4ab-873c-40ae-be40-b8addab28257 req-95c256fc-6491-4878-a5ff-ed27c3f67c8f service nova] Acquiring lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-99e3c4ab-873c-40ae-be40-b8addab28257 req-95c256fc-6491-4878-a5ff-ed27c3f67c8f service nova] Acquired lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:17 user nova-compute[75102]: DEBUG nova.network.neutron [req-99e3c4ab-873c-40ae-be40-b8addab28257 req-95c256fc-6491-4878-a5ff-ed27c3f67c8f service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Refreshing network info cache for port d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:18 user nova-compute[75102]: INFO nova.compute.manager [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Terminating instance
Nov 10 16:18:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG nova.objects.instance [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lazy-loading 'flavor' on Instance uuid 83ad82f3-4e34-46fd-94a6-71adb8884eda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.154s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-99e3c4ab-873c-40ae-be40-b8addab28257 req-95c256fc-6491-4878-a5ff-ed27c3f67c8f service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Updated VIF entry in instance network info cache for port d9965142-35ab-44e0-82bc-b3e8099c58ad. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-99e3c4ab-873c-40ae-be40-b8addab28257 req-95c256fc-6491-4878-a5ff-ed27c3f67c8f service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Updating instance_info_cache with network_info: [{"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:18 user nova-compute[75102]: INFO nova.compute.manager [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Attaching volume 05532186-37ef-4e14-8ac6-e33aa6fd25e0 to /dev/vdb
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-99e3c4ab-873c-40ae-be40-b8addab28257 req-95c256fc-6491-4878-a5ff-ed27c3f67c8f service nova] Releasing lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-bb1888e1-84e6-4429-bcdc-16e16a5191d7 req-c4130298-bfb7-4e9a-8a84-74ba558a4af2 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received event network-vif-unplugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bb1888e1-84e6-4429-bcdc-16e16a5191d7 req-c4130298-bfb7-4e9a-8a84-74ba558a4af2 service nova] Acquiring lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bb1888e1-84e6-4429-bcdc-16e16a5191d7 req-c4130298-bfb7-4e9a-8a84-74ba558a4af2 service nova] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bb1888e1-84e6-4429-bcdc-16e16a5191d7 req-c4130298-bfb7-4e9a-8a84-74ba558a4af2 service nova] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-bb1888e1-84e6-4429-bcdc-16e16a5191d7 req-c4130298-bfb7-4e9a-8a84-74ba558a4af2 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] No waiting events found dispatching network-vif-unplugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-bb1888e1-84e6-4429-bcdc-16e16a5191d7 req-c4130298-bfb7-4e9a-8a84-74ba558a4af2 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received event network-vif-unplugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG os_brick.utils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b02604c-6a72-4476-8f69-281db22afcc5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a013fbb-f980-403b-924c-87a103e520f7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12ed377-8b32-43b3-878e-e607decd1814]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1347695c-1991-48f0-a100-6f9a213cf50e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:18 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:18:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5378283-ffcd-4c79-a965-812f0f7e983f]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG os_brick.utils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:18:18 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Updating existing volume attachment record: 8519eccc-f80e-4442-81e2-c9d570758b5b {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:18:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Instance destroyed successfully.
Nov 10 16:18:19 user nova-compute[75102]: DEBUG nova.objects.instance [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lazy-loading 'resources' on Instance uuid e7db38aa-7e5d-4b9a-a7f4-362819172489 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-1361708087',display_name='tempest-DeleteServersTestJSON-server-1361708087',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-1361708087',id=1,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4bdba856e084870ad806f7f7b807bef',ramdisk_id='',reservation_id='r-q4x59myx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-2037127427',owner_user_name='tempest-DeleteServersTestJSON-2037127427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:03Z,user_data=None,user_id='2f59ff0fdd8a4b9e8ae6242cfffdc772',uuid=e7db38aa-7e5d-4b9a-a7f4-362819172489,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Converting VIF {"id": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "address": "fa:16:3e:06:5c:a8", "network": {"id": "c4cc5530-8005-4d14-9d4b-4535e599f300", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-720280306-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4bdba856e084870ad806f7f7b807bef", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6bdbeeb7-71", "ovs_interfaceid": "6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:06:5c:a8,bridge_name='br-int',has_traffic_filtering=True,id=6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a,network=Network(c4cc5530-8005-4d14-9d4b-4535e599f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdbeeb7-71') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_vif [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:5c:a8,bridge_name='br-int',has_traffic_filtering=True,id=6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a,network=Network(c4cc5530-8005-4d14-9d4b-4535e599f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdbeeb7-71') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6bdbeeb7-71, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3d911d76-81be-4164-a8a8-03043720dce9) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:19 user nova-compute[75102]: INFO os_vif [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:06:5c:a8,bridge_name='br-int',has_traffic_filtering=True,id=6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a,network=Network(c4cc5530-8005-4d14-9d4b-4535e599f300),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6bdbeeb7-71')
Nov 10 16:18:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AmJtqGrX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:18:19 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c17e3d-5b02-4d52-9331-1c0671ea5d56]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:18:19 user nova-compute[75102]: No targets found.
Nov 10 16:18:19 user nova-compute[75102]: iSNS:
Nov 10 16:18:19 user nova-compute[75102]: No targets found.
Nov 10 16:18:19 user nova-compute[75102]: STATIC:
Nov 10 16:18:19 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159
Nov 10 16:18:19 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:18:19 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:18:19 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea
Nov 10 16:18:19 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:18:19 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:18:19 user nova-compute[75102]: FIRMWARE:
Nov 10 16:18:19 user nova-compute[75102]: No targets found.
Nov 10 16:18:19 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:18:19 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:18:19 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f44682-5732-4452-8d35-7e75583557cd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85a845d-24e7-4a19-8c3d-b27fe0c5c84c]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:18:19 user nova-compute[75102]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea (non-flash)
Nov 10 16:18:19 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:18:19 user nova-compute[75102]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea (non-flash)
Nov 10 16:18:19 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7459d900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e41ffc-deb3-43a2-b590-dccf4a481a45]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65af629-8a93-485a-bed1-2902bf68faa0]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[71cbf750-053f-42c0-a421-b988a1366e94]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.033s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[33fda877-64b5-4fd2-88d2-f93667eb1beb]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8c95ab-defc-49ee-b230-7f04fd93e7a5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0f07792-3f68-4088-b0f0-c954c4903cec]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea, portal: 172.16.0.220,3260]
Nov 10 16:18:19 user nova-compute[75102]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea, portal: 172.16.0.220,3260] successful.
Nov 10 16:18:19 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd8098b7-45ed-422e-9e0f-ee10de3b2fea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4826f297-e4b3-45a6-b0ad-ec76241f7300]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] <== disconnect_volume: return (315ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:18:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Deleting instance files /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489_del
Nov 10 16:18:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Deletion of /opt/stack/data/nova/instances/e7db38aa-7e5d-4b9a-a7f4-362819172489_del complete
Nov 10 16:18:19 user nova-compute[75102]: INFO nova.compute.manager [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Took 1.37 seconds to destroy the instance on the hypervisor.
Nov 10 16:18:19 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:18:19 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:18:20 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:20 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Took 0.62 seconds to deallocate network for instance.
Nov 10 16:18:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-544b6f09-f96e-47b7-aa1d-0f4de8600586 req-b0447962-d386-4dd5-b319-9cff58bb58a7 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received event network-vif-deleted-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:20 user nova-compute[75102]: INFO nova.compute.manager [req-544b6f09-f96e-47b7-aa1d-0f4de8600586 req-b0447962-d386-4dd5-b319-9cff58bb58a7 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Neutron deleted interface 6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a; detaching it from the instance and deleting it from the info cache
Nov 10 16:18:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-544b6f09-f96e-47b7-aa1d-0f4de8600586 req-b0447962-d386-4dd5-b319-9cff58bb58a7 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-544b6f09-f96e-47b7-aa1d-0f4de8600586 req-b0447962-d386-4dd5-b319-9cff58bb58a7 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Detach interface failed, port_id=6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a, reason: Instance e7db38aa-7e5d-4b9a-a7f4-362819172489 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:18:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-2b5e9e60-991d-44cc-8ee3-0238b54f0ead req-461c9380-dd9f-4244-a80d-4ab455abf989 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received event network-vif-plugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2b5e9e60-991d-44cc-8ee3-0238b54f0ead req-461c9380-dd9f-4244-a80d-4ab455abf989 service nova] Acquiring lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2b5e9e60-991d-44cc-8ee3-0238b54f0ead req-461c9380-dd9f-4244-a80d-4ab455abf989 service nova] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2b5e9e60-991d-44cc-8ee3-0238b54f0ead req-461c9380-dd9f-4244-a80d-4ab455abf989 service nova] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-2b5e9e60-991d-44cc-8ee3-0238b54f0ead req-461c9380-dd9f-4244-a80d-4ab455abf989 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] No waiting events found dispatching network-vif-plugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:18:20 user nova-compute[75102]: WARNING nova.compute.manager [req-2b5e9e60-991d-44cc-8ee3-0238b54f0ead req-461c9380-dd9f-4244-a80d-4ab455abf989 service nova] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Received unexpected event network-vif-plugged-6bdbeeb7-71ec-4f00-95c1-5b7c4d0a549a for instance with vm_state active and task_state deleting.
Nov 10 16:18:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-5180ddd8-3e38-49ab-88f1-79fbe9549066 req-4272291b-3dd9-440c-a5d3-8d542c532db8 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-changed-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-5180ddd8-3e38-49ab-88f1-79fbe9549066 req-4272291b-3dd9-440c-a5d3-8d542c532db8 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Refreshing instance network info cache due to event network-changed-85ff080c-d374-4dde-aec4-b0dbd4b835b0. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5180ddd8-3e38-49ab-88f1-79fbe9549066 req-4272291b-3dd9-440c-a5d3-8d542c532db8 service nova] Acquiring lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5180ddd8-3e38-49ab-88f1-79fbe9549066 req-4272291b-3dd9-440c-a5d3-8d542c532db8 service nova] Acquired lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-5180ddd8-3e38-49ab-88f1-79fbe9549066 req-4272291b-3dd9-440c-a5d3-8d542c532db8 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Refreshing network info cache for port 85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "interface-73ffbf3a-c989-4165-b886-9b5b6ca94e90-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "interface-73ffbf3a-c989-4165-b886-9b5b6ca94e90-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG nova.objects.instance [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lazy-loading 'flavor' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-5180ddd8-3e38-49ab-88f1-79fbe9549066 req-4272291b-3dd9-440c-a5d3-8d542c532db8 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updated VIF entry in instance network info cache for port 85ff080c-d374-4dde-aec4-b0dbd4b835b0. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-5180ddd8-3e38-49ab-88f1-79fbe9549066 req-4272291b-3dd9-440c-a5d3-8d542c532db8 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updating instance_info_cache with network_info: [{"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5180ddd8-3e38-49ab-88f1-79fbe9549066 req-4272291b-3dd9-440c-a5d3-8d542c532db8 service nova] Releasing lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:24 user nova-compute[75102]: DEBUG nova.objects.instance [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lazy-loading 'pci_requests' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:18:24 user nova-compute[75102]: DEBUG nova.objects.base [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Object Instance<73ffbf3a-c989-4165-b886-9b5b6ca94e90> lazy-loaded attributes: flavor,pci_requests {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:18:24 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:18:24 user nova-compute[75102]: DEBUG nova.policy [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c3feb9b9df3e4b80ae23321c15848efa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '941ab220f5014f92940dc69ff115395d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:18:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:24 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Successfully created port: 04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-219e413a-ca27-4ae8-bd92-08f8103c9071 req-dec452e5-b923-42b2-afba-d3d6a323ba5d service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received event network-changed-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-219e413a-ca27-4ae8-bd92-08f8103c9071 req-dec452e5-b923-42b2-afba-d3d6a323ba5d service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Refreshing instance network info cache due to event network-changed-f1e845fa-5065-4ed4-a571-28b2772e65fa. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-219e413a-ca27-4ae8-bd92-08f8103c9071 req-dec452e5-b923-42b2-afba-d3d6a323ba5d service nova] Acquiring lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-219e413a-ca27-4ae8-bd92-08f8103c9071 req-dec452e5-b923-42b2-afba-d3d6a323ba5d service nova] Acquired lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG nova.network.neutron [req-219e413a-ca27-4ae8-bd92-08f8103c9071 req-dec452e5-b923-42b2-afba-d3d6a323ba5d service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Refreshing network info cache for port f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Successfully updated port: 04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquired lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-4d309c2e-cb3f-43f6-a79b-26d34a0f77b6 req-ed05ae62-e063-44ec-bac2-f5bef3eaf7c0 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-changed-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-4d309c2e-cb3f-43f6-a79b-26d34a0f77b6 req-ed05ae62-e063-44ec-bac2-f5bef3eaf7c0 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Refreshing instance network info cache due to event network-changed-04e5a27d-f5c1-404a-b694-36e87ac2be8b. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4d309c2e-cb3f-43f6-a79b-26d34a0f77b6 req-ed05ae62-e063-44ec-bac2-f5bef3eaf7c0 service nova] Acquiring lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG nova.network.neutron [req-219e413a-ca27-4ae8-bd92-08f8103c9071 req-dec452e5-b923-42b2-afba-d3d6a323ba5d service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updated VIF entry in instance network info cache for port f1e845fa-5065-4ed4-a571-28b2772e65fa. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG nova.network.neutron [req-219e413a-ca27-4ae8-bd92-08f8103c9071 req-dec452e5-b923-42b2-afba-d3d6a323ba5d service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updating instance_info_cache with network_info: [{"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-219e413a-ca27-4ae8-bd92-08f8103c9071 req-dec452e5-b923-42b2-afba-d3d6a323ba5d service nova] Releasing lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updating instance_info_cache with network_info: [{"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Releasing lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4d309c2e-cb3f-43f6-a79b-26d34a0f77b6 req-ed05ae62-e063-44ec-bac2-f5bef3eaf7c0 service nova] Acquired lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.network.neutron [req-4d309c2e-cb3f-43f6-a79b-26d34a0f77b6 req-ed05ae62-e063-44ec-bac2-f5bef3eaf7c0 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Refreshing network info cache for port 04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13933405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13933405',id=6,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+qq64H5Vbjx8Inx+6yEga0vLwbJNL0epCbJdKi3Gom0oTPj8h30FZ5w3N1JQxqZvcLGfPUVHHvK4qcUmB4N/TDmyU59bYy0FuC/NEh/MF4Ce92Mb5OlPfx9teriOA4hQ==',key_name='tempest-keypair-1570286825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='941ab220f5014f92940dc69ff115395d',ramdisk_id='',reservation_id='r-0ilj5ijd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-777879608',owner_user_name='tempest-TaggedAttachmentsTest-777879608-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3feb9b9df3e4b80ae23321c15848efa',uuid=73ffbf3a-c989-4165-b886-9b5b6ca94e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converting VIF {"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG os_vif [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e876aee-45be-51fe-884c-565f9aa238e0', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap04e5a27d-f5, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap04e5a27d-f5, col_values=(('qos', UUID('bc95172e-9c4e-40d1-a93c-d8537f6db36d')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap04e5a27d-f5, col_values=(('external_ids', {'iface-id': '04e5a27d-f5c1-404a-b694-36e87ac2be8b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:36:f2', 'vm-uuid': '73ffbf3a-c989-4165-b886-9b5b6ca94e90'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: INFO os_vif [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5')
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13933405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13933405',id=6,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+qq64H5Vbjx8Inx+6yEga0vLwbJNL0epCbJdKi3Gom0oTPj8h30FZ5w3N1JQxqZvcLGfPUVHHvK4qcUmB4N/TDmyU59bYy0FuC/NEh/MF4Ce92Mb5OlPfx9teriOA4hQ==',key_name='tempest-keypair-1570286825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='941ab220f5014f92940dc69ff115395d',ramdisk_id='',reservation_id='r-0ilj5ijd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-777879608',owner_user_name='tempest-TaggedAttachmentsTest-777879608-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3feb9b9df3e4b80ae23321c15848efa',uuid=73ffbf3a-c989-4165-b886-9b5b6ca94e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converting VIF {"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] attach device xml: <interface type="ethernet">
Nov 10 16:18:26 user nova-compute[75102]:   <mac address="fa:16:3e:98:36:f2"/>
Nov 10 16:18:26 user nova-compute[75102]:   <model type="virtio"/>
Nov 10 16:18:26 user nova-compute[75102]:   <mtu size="1442"/>
Nov 10 16:18:26 user nova-compute[75102]:   <target dev="tap04e5a27d-f5"/>
Nov 10 16:18:26 user nova-compute[75102]: </interface>
Nov 10 16:18:26 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] No BDM found with device name hda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] No VIF found with MAC fa:16:3e:e7:33:d1, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:18:26 user nova-compute[75102]:   <nova:package version="0.0.0"/>
Nov 10 16:18:26 user nova-compute[75102]:   <nova:name>tempest-device-tagging-server-13933405</nova:name>
Nov 10 16:18:26 user nova-compute[75102]:   <nova:creationTime>2023-11-10 16:18:26</nova:creationTime>
Nov 10 16:18:26 user nova-compute[75102]:   <nova:flavor name="m1.tiny">
Nov 10 16:18:26 user nova-compute[75102]:     <nova:memory>512</nova:memory>
Nov 10 16:18:26 user nova-compute[75102]:     <nova:disk>1</nova:disk>
Nov 10 16:18:26 user nova-compute[75102]:     <nova:swap>0</nova:swap>
Nov 10 16:18:26 user nova-compute[75102]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:18:26 user nova-compute[75102]:     <nova:vcpus>1</nova:vcpus>
Nov 10 16:18:26 user nova-compute[75102]:   </nova:flavor>
Nov 10 16:18:26 user nova-compute[75102]:   <nova:owner>
Nov 10 16:18:26 user nova-compute[75102]:     <nova:user uuid="c3feb9b9df3e4b80ae23321c15848efa">tempest-TaggedAttachmentsTest-777879608-project-member</nova:user>
Nov 10 16:18:26 user nova-compute[75102]:     <nova:project uuid="941ab220f5014f92940dc69ff115395d">tempest-TaggedAttachmentsTest-777879608</nova:project>
Nov 10 16:18:26 user nova-compute[75102]:   </nova:owner>
Nov 10 16:18:26 user nova-compute[75102]:   <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:18:26 user nova-compute[75102]:   <nova:ports>
Nov 10 16:18:26 user nova-compute[75102]:     <nova:port uuid="85ff080c-d374-4dde-aec4-b0dbd4b835b0">
Nov 10 16:18:26 user nova-compute[75102]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:18:26 user nova-compute[75102]:     </nova:port>
Nov 10 16:18:26 user nova-compute[75102]:     <nova:port uuid="04e5a27d-f5c1-404a-b694-36e87ac2be8b">
Nov 10 16:18:26 user nova-compute[75102]:       <nova:ip type="fixed" address="10.10.10.69" ipVersion="4"/>
Nov 10 16:18:26 user nova-compute[75102]:     </nova:port>
Nov 10 16:18:26 user nova-compute[75102]:   </nova:ports>
Nov 10 16:18:26 user nova-compute[75102]: </nova:instance>
Nov 10 16:18:26 user nova-compute[75102]:  {{(pid=75102) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 16:18:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fa6e397a-1547-46cb-af3a-877b5cbfe6e0 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "interface-73ffbf3a-c989-4165-b886-9b5b6ca94e90-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 3.092s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG nova.network.neutron [req-4d309c2e-cb3f-43f6-a79b-26d34a0f77b6 req-ed05ae62-e063-44ec-bac2-f5bef3eaf7c0 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updated VIF entry in instance network info cache for port 04e5a27d-f5c1-404a-b694-36e87ac2be8b. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG nova.network.neutron [req-4d309c2e-cb3f-43f6-a79b-26d34a0f77b6 req-ed05ae62-e063-44ec-bac2-f5bef3eaf7c0 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updating instance_info_cache with network_info: [{"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4d309c2e-cb3f-43f6-a79b-26d34a0f77b6 req-ed05ae62-e063-44ec-bac2-f5bef3eaf7c0 service nova] Releasing lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG nova.compute.manager [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-plugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG nova.compute.manager [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] No waiting events found dispatching network-vif-plugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:18:27 user nova-compute[75102]: WARNING nova.compute.manager [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received unexpected event network-vif-plugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b for instance with vm_state active and task_state None.
Nov 10 16:18:27 user nova-compute[75102]: DEBUG nova.compute.manager [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-plugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG nova.compute.manager [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] No waiting events found dispatching network-vif-plugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:18:27 user nova-compute[75102]: WARNING nova.compute.manager [req-e62b2763-1831-4cac-b38e-28fddd6f7c11 req-7dd12b8b-7849-4872-9cd0-603fdecc8a61 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received unexpected event network-vif-plugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b for instance with vm_state active and task_state None.
Nov 10 16:18:27 user nova-compute[75102]: INFO nova.compute.manager [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] [instance: e7db38aa-7e5d-4b9a-a7f4-362819172489] Took 7.58 seconds to detach 1 volumes for instance.
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG nova.objects.instance [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lazy-loading 'flavor' on Instance uuid ab373f84-9ba6-4336-bca7-602464b61fb3 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:18:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:28 user nova-compute[75102]: INFO nova.virt.block_device [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Booting with volume 5f540661-66a9-48fb-9f99-56e935034a1e at /dev/vdb
Nov 10 16:18:28 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.320s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:28 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Deleted allocations for instance e7db38aa-7e5d-4b9a-a7f4-362819172489
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lazy-loading 'flavor' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8457a377-c21e-48bd-bed4-906d60802631 tempest-DeleteServersTestJSON-2037127427 tempest-DeleteServersTestJSON-2037127427-project-member] Lock "e7db38aa-7e5d-4b9a-a7f4-362819172489" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.136s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG os_brick.utils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2fd5a5-7e8f-411d-b023-17766a8f9611]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdba17c6-7e4a-4eaf-a193-4d8945bb2a0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4021298a-070e-4e0d-a3cb-2e5adcf52006]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bef50d6-41ad-4726-a189-c9959e742520]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:28 user nova-compute[75102]: INFO nova.compute.manager [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Attaching volume ee18ac51-e08b-4fa4-9a53-1bdd104cd65b to /dev/vdb
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:28 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[920b418a-384b-422f-a5a6-1c2c89c315b3]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG os_brick.utils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] <== get_connector_properties: return (159ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating existing volume attachment record: be363b1d-3cb2-44da-a21f-4daf7005ccd8 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:28 user nova-compute[75102]: INFO nova.compute.manager [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Attaching volume df7e03fe-e51a-4167-a5c0-d4e05cf620d4 to /dev/vdb
Nov 10 16:18:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:18:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:18:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:18:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:18:48 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:18:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:48 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:18:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:51 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:18:51 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8028MB free_disk=25.585323333740234GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 83ad82f3-4e34-46fd-94a6-71adb8884eda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ab373f84-9ba6-4336-bca7-602464b61fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6458fc11-6612-4108-addd-ce61d935431e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 2c40f2a3-dbfb-497d-8ec3-df38105cad20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:18:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.469s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:18:52 user nova-compute[75102]: INFO nova.compute.claims [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Claim successful on node user
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.363s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:18:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:18:52 user nova-compute[75102]: DEBUG nova.policy [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3149d0620bf64829aa4eec99a2cddee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e926f56f914e7488a50f5bb78a33cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:18:52 user nova-compute[75102]: INFO nova.virt.block_device [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Booting with blank volume at /dev/vda
Nov 10 16:18:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:53 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Successfully created port: 8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Successfully updated port: 8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquired lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-8971b4e6-5fa5-4e57-9ebc-257812ecae4f req-71c8193f-5843-4076-94e4-d05da99c173e service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-changed-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-8971b4e6-5fa5-4e57-9ebc-257812ecae4f req-71c8193f-5843-4076-94e4-d05da99c173e service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Refreshing instance network info cache due to event network-changed-8e334149-8bda-4d77-a44b-296a7ecf7a7d. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8971b4e6-5fa5-4e57-9ebc-257812ecae4f req-71c8193f-5843-4076-94e4-d05da99c173e service nova] Acquiring lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updating instance_info_cache with network_info: [{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Releasing lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Instance network_info: |[{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8971b4e6-5fa5-4e57-9ebc-257812ecae4f req-71c8193f-5843-4076-94e4-d05da99c173e service nova] Acquired lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:18:54 user nova-compute[75102]: DEBUG nova.network.neutron [req-8971b4e6-5fa5-4e57-9ebc-257812ecae4f req-71c8193f-5843-4076-94e4-d05da99c173e service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Refreshing network info cache for port 8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:18:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-8971b4e6-5fa5-4e57-9ebc-257812ecae4f req-71c8193f-5843-4076-94e4-d05da99c173e service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updated VIF entry in instance network info cache for port 8e334149-8bda-4d77-a44b-296a7ecf7a7d. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:18:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-8971b4e6-5fa5-4e57-9ebc-257812ecae4f req-71c8193f-5843-4076-94e4-d05da99c173e service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updating instance_info_cache with network_info: [{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:18:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8971b4e6-5fa5-4e57-9ebc-257812ecae4f req-71c8193f-5843-4076-94e4-d05da99c173e service nova] Releasing lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:18:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.utils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[09385eb2-fe30-4387-87b0-8b51ec83d2dc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c399d8-1411-4b1d-8692-a97fdacc2197]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3113632f-3e05-42c6-b05f-d783cac1d409]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c2483d-fc38-4199-b847-153f27fb395c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:57 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcf035e2-bbc0-4316-b6d3-44d93631c3a0]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.utils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updating existing volume attachment record: ed7b7140-408d-4e73-a3f5-b329248346f4 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:18:57 user nova-compute[75102]: INFO nova.virt.block_device [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Booting with volume 2a40ac1e-af7b-4a08-99b8-448c9a463f22 at /dev/vdc
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.utils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[748a0fbb-c3cd-46bd-8d79-9385ec0f0956]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[659454c3-45aa-4583-8923-b13c6d9fd96b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f964084-ac88-43e5-b5b6-870f5508f52b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc533c4f-b28a-41a9-a15b-304f4f3fac50]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:18:57 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:18:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1acc4b22-b515-45c9-af2e-2e0a8d90da91]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG os_brick.utils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] <== get_connector_properties: return (108ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:18:57 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updating existing volume attachment record: 779c1089-13dc-40b8-8c40-b7b0f61d66e4 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:18:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-2ee52662-45de-480e-8715-1ea016878a3a req-4ea6b41d-66dd-4d49-8e54-050c0c695a2f service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-changed-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:19:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-2ee52662-45de-480e-8715-1ea016878a3a req-4ea6b41d-66dd-4d49-8e54-050c0c695a2f service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Refreshing instance network info cache due to event network-changed-57d19842-a13a-4616-b2fd-9957fc90f7c7. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:19:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2ee52662-45de-480e-8715-1ea016878a3a req-4ea6b41d-66dd-4d49-8e54-050c0c695a2f service nova] Acquiring lock "refresh_cache-6458fc11-6612-4108-addd-ce61d935431e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:19:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2ee52662-45de-480e-8715-1ea016878a3a req-4ea6b41d-66dd-4d49-8e54-050c0c695a2f service nova] Acquired lock "refresh_cache-6458fc11-6612-4108-addd-ce61d935431e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:19:08 user nova-compute[75102]: DEBUG nova.network.neutron [req-2ee52662-45de-480e-8715-1ea016878a3a req-4ea6b41d-66dd-4d49-8e54-050c0c695a2f service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Refreshing network info cache for port 57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG nova.network.neutron [req-2ee52662-45de-480e-8715-1ea016878a3a req-4ea6b41d-66dd-4d49-8e54-050c0c695a2f service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Updated VIF entry in instance network info cache for port 57d19842-a13a-4616-b2fd-9957fc90f7c7. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG nova.network.neutron [req-2ee52662-45de-480e-8715-1ea016878a3a req-4ea6b41d-66dd-4d49-8e54-050c0c695a2f service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Updating instance_info_cache with network_info: [{"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2ee52662-45de-480e-8715-1ea016878a3a req-4ea6b41d-66dd-4d49-8e54-050c0c695a2f service nova] Releasing lock "refresh_cache-6458fc11-6612-4108-addd-ce61d935431e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBwaTgUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:19:09 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:19:09 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:19:09 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[291f5810-68db-436d-929d-ee4436c4dabd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:19:09 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b828b65b-cb8e-40db-82d0-abee61cc83a0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753] added
Nov 10 16:19:09 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[df692e6c-c84e-4d75-8266-7bc3a328bcac]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff21ed7-9629-4e3c-a12b-4383ff9177a1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBwaTgUM {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jBwaTgUM" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f050f035-a0ce-46cc-987d-49855e33effc]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jBwaTgUM'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9331dcf-86f8-4529-88c5-d46319d0fbd8]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e02c8554-aafb-45cd-8ca3-bc5c3bc8f4d7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[adcae551-a98a-4269-b9f5-fcc57526cb45]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753, portal: 172.16.0.220,3260]
Nov 10 16:19:10 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753, portal: 172.16.0.220,3260] successful.
Nov 10 16:19:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b32cee-1940-4737-ba68-0a2d46ff8043]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[31b857f1-f7cc-441f-a6af-e5ff18c8a57a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:10 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:10 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] HCTL ('34', '-', '-', 0) found on session 4 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfde54b-56a0-49eb-913b-553e80668dc7]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Searching for a device in session 4 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:19:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBwaTgUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26531383936633030', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26531383936633030', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG nova.objects.instance [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lazy-loading 'flavor' on Instance uuid cc9e365b-8b0a-40db-bbc4-026f609cdd7a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:19:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:19:11 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:19:11 user nova-compute[75102]:   <target dev="sdc" bus="scsi"/>
Nov 10 16:19:11 user nova-compute[75102]:   <serial>b6bcba7a-cd67-4243-87fd-4fa95722e753</serial>
Nov 10 16:19:11 user nova-compute[75102]:   <address type="drive" controller="0" unit="2"/>
Nov 10 16:19:11 user nova-compute[75102]: </disk>
Nov 10 16:19:11 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] No BDM found with device name sda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:19:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] No VIF found with MAC fa:16:3e:e6:1e:7d, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:19:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvaltFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:19:30 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:19:30 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:19:30 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1ad5f1e-f3e5-40df-8cc8-56c39cfc9049]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:19:30 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1223facc-7c27-4884-a24a-2917dc383bc5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0] added
Nov 10 16:19:30 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d45643-d850-4587-a75f-e040cf62088f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b6e9e10-9cbb-4946-b5fe-fcd401df9b81]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvaltFpQ {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MvaltFpQ" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[211acf3f-baac-44d0-a6d7-07b8bfb11d86]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MvaltFpQ'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a978ef69-16ec-4dd1-82f4-f979bb3f9f8e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa1ff1c-cb7b-473f-bdbd-83ae43885161]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca8e17-5a82-47aa-a288-a9ca3ea9834a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0, portal: 172.16.0.220,3260]
Nov 10 16:19:30 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0, portal: 172.16.0.220,3260] successful.
Nov 10 16:19:30 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba205c21-fcdb-47c1-ba02-e697d0df90c1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ab25d2-a431-48b7-917b-89354142332f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:19:30 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] HCTL ('35', '-', '-', 0) found on session 5 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9799dde-4040-4f62-9850-7c7392f6e868]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:30 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Searching for a device in session 5 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvaltFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG os_brick.utils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de4133c-48f7-4cdf-b2b1-8ca3dc61d6fc]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[931fb058-1f13-4613-85ca-2981769f0bea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc5cb60-9a13-489f-ac9c-f3dd26b1fcd1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe3604e-e8f4-418c-8061-e5fdd1e0a4e9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:19:31 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d63eb6b-7697-4607-87fe-65fe2af2f28f]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG os_brick.utils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating existing volume attachment record: 27af1261-b1ff-49b9-ac8b-0361cd815125 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2e76d85a-05f5-4343-8793-9aefb1fc7dde tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 75.819s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:19:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:19:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26631343861653838', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:19:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631343861653838', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:19:32 user nova-compute[75102]: DEBUG nova.objects.instance [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lazy-loading 'flavor' on Instance uuid 83ad82f3-4e34-46fd-94a6-71adb8884eda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:19:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] attach device xml: <disk type="block" device="disk">
Nov 10 16:19:32 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:19:32 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:19:32 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:19:32 user nova-compute[75102]:   <serial>05532186-37ef-4e14-8ac6-e33aa6fd25e0</serial>
Nov 10 16:19:32 user nova-compute[75102]: </disk>
Nov 10 16:19:32 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:19:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:19:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:19:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] No VIF found with MAC fa:16:3e:05:fa:9a, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:19:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxWOZbRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:19:34 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:19:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:19:34 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:19:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:19:34 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:19:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6290901d-9115-4b8f-b59c-7c31b9212dcc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:19:34 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7186fc3-8a48-4a02-b8f4-475b70f80509]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4] added
Nov 10 16:19:34 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28685a5-b11e-4bdd-9519-807c2c7085db]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9b16c2f-e168-4fd3-826a-1bfa1ab3bd09]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxWOZbRa {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oxWOZbRa" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[19eb2503-e715-405d-9f36-8fae4d5c82c2]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oxWOZbRa'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3907149-e269-4e7c-9f3b-429fd46ed3e3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e1a75f-9e4b-47a6-b4a0-4c0558910bc2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[da90a9ca-e81d-4950-9b5c-968068724ea0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4, portal: 172.16.0.220,3260]
Nov 10 16:19:35 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4, portal: 172.16.0.220,3260] successful.
Nov 10 16:19:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c4eb4a2-3d61-486b-93db-1f34938b845a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3846ed-e0d0-46fb-b330-6a48fc29ddad]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:19:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a3b4ca-1538-4c0b-b761-856d4a206f8a]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxWOZbRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-150730fc-0df2-43cc-912d-be8bac0aae84 tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 76.780s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.utils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[66590656-6f0b-4be6-96b8-e7e203513555]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a0d79dd-0c27-41dc-b3d1-8179f8470161]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4bddb1-91bb-4e14-b0f7-ba4914a765be]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[11881873-95c5-4ed3-bc56-f02d0c648950]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:19:35 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:19:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[61c517bf-c23e-4931-9084-6d06cca18397]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG os_brick.utils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:19:35 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updating existing volume attachment record: 6e87894e-183d-41c0-84fa-d5ddc996f029 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:19:35 user nova-compute[75102]: INFO nova.compute.manager [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Rebuilding instance
Nov 10 16:19:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23763346632396338', 'path': '/dev/sde'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763346632396338', 'path': '/dev/sde'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lazy-loading 'flavor' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:19:36 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:19:36 user nova-compute[75102]:   <source dev="/dev/sde"/>
Nov 10 16:19:36 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:19:36 user nova-compute[75102]:   <serial>df7e03fe-e51a-4167-a5c0-d4e05cf620d4</serial>
Nov 10 16:19:36 user nova-compute[75102]: </disk>
Nov 10 16:19:36 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-c8caf6e6-741e-4cff-8887-cfa7014a1ef3 req-6b28d77d-60e9-499d-abe5-ca8840931515 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-unplugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8caf6e6-741e-4cff-8887-cfa7014a1ef3 req-6b28d77d-60e9-499d-abe5-ca8840931515 service nova] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8caf6e6-741e-4cff-8887-cfa7014a1ef3 req-6b28d77d-60e9-499d-abe5-ca8840931515 service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c8caf6e6-741e-4cff-8887-cfa7014a1ef3 req-6b28d77d-60e9-499d-abe5-ca8840931515 service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-c8caf6e6-741e-4cff-8887-cfa7014a1ef3 req-6b28d77d-60e9-499d-abe5-ca8840931515 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] No waiting events found dispatching network-vif-unplugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:19:36 user nova-compute[75102]: WARNING nova.compute.manager [req-c8caf6e6-741e-4cff-8887-cfa7014a1ef3 req-6b28d77d-60e9-499d-abe5-ca8840931515 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received unexpected event network-vif-unplugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 for instance with vm_state active and task_state rebuilding.
Nov 10 16:19:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] No BDM found with device name hda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] No VIF found with MAC fa:16:3e:e7:33:d1, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:37 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance destroyed successfully.
Nov 10 16:19:37 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance destroyed successfully.
Nov 10 16:19:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-598809847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-762086081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCYcmc6fbkVb87dY5vNaRKdJPEGkW/2zIEZbxcYW56VTIvJZFnE6PxiWcAsvDS1lc7Hspn+uCDjxoiD1E6lbtqupamzWdbjY1UQdTjVnbkbvuyi/ytsTEUONZgVQW/ong==',key_name='tempest-keypair-583205912',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:17:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23ed0272e95b41a6b623002f93b1511f',ramdisk_id='',reservation_id='r-wi7m0598',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-725654860',owner_user_name='tempest-ServerActionsV293TestJSON-725654860-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:19:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a50fb02c29f417d97115fdf45ffbcee',uuid=6458fc11-6612-4108-addd-ce61d935431e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converting VIF {"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_vif [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57d19842-a1, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1a9b1f26-49f9-4ded-bf59-b1cb5a2d42ec) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:37 user nova-compute[75102]: INFO os_vif [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1')
Nov 10 16:19:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMVPuJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:19:37 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[08654ee8-c0b4-487f-8c36-29eae10c7fad]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:19:37 user nova-compute[75102]: No targets found.
Nov 10 16:19:37 user nova-compute[75102]: iSNS:
Nov 10 16:19:37 user nova-compute[75102]: No targets found.
Nov 10 16:19:37 user nova-compute[75102]: STATIC:
Nov 10 16:19:37 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753
Nov 10 16:19:37 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:19:37 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:19:37 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159
Nov 10 16:19:37 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:19:37 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:19:37 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4
Nov 10 16:19:37 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:19:37 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:19:37 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0
Nov 10 16:19:37 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:19:37 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:19:37 user nova-compute[75102]: FIRMWARE:
Nov 10 16:19:37 user nova-compute[75102]: No targets found.
Nov 10 16:19:37 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:19:37 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:19:37 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c939484e-5726-49c2-a2a5-8ab70a022a15]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9968c614-4a3d-4c6e-bcca-98722fd4715b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:37 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:37 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:19:37 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:19:37 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:19:37 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:19:37 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:19:37 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:19:37 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74585900>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3bce81-2b68-4bfa-8e83-8f2194c65ac6]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[15549c15-e257-4055-9114-875be0ed25fb]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4f8e46-0037-4843-897c-b62026e01de3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.043s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd997af-03d8-465c-b46a-6ef3b5160739]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2302d059', '/dev/disk/by-id/scsi-1SCST_BIO2302d059-c83e1c7e01222c5f', '/dev/disk/by-id/scsi-26338336531633765') {{(pid=85940) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdabdd1c-b960-46e1-82ef-80ba2ef1ee38]: (4, None) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[772c19d7-0d3c-452e-86ba-91725a405c08]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b2e8d3-01a4-4557-91a3-865b686032c3]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260]
Nov 10 16:19:37 user nova-compute[75102]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260] successful.
Nov 10 16:19:37 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[72f70300-8531-4bd3-b78d-dd0a253276ea]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.328s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] <== disconnect_volume: return (329ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:19:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:19:37 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Deleting instance files /opt/stack/data/nova/instances/6458fc11-6612-4108-addd-ce61d935431e_del
Nov 10 16:19:37 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Deletion of /opt/stack/data/nova/instances/6458fc11-6612-4108-addd-ce61d935431e_del complete
Nov 10 16:19:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-add21771-334b-4ca3-bf17-e7cc598bccca req-e289cf98-1f58-46eb-b1d3-46e8493fc771 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:19:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-add21771-334b-4ca3-bf17-e7cc598bccca req-e289cf98-1f58-46eb-b1d3-46e8493fc771 service nova] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:19:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-add21771-334b-4ca3-bf17-e7cc598bccca req-e289cf98-1f58-46eb-b1d3-46e8493fc771 service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:19:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-add21771-334b-4ca3-bf17-e7cc598bccca req-e289cf98-1f58-46eb-b1d3-46e8493fc771 service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:19:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-add21771-334b-4ca3-bf17-e7cc598bccca req-e289cf98-1f58-46eb-b1d3-46e8493fc771 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] No waiting events found dispatching network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:19:38 user nova-compute[75102]: WARNING nova.compute.manager [req-add21771-334b-4ca3-bf17-e7cc598bccca req-e289cf98-1f58-46eb-b1d3-46e8493fc771 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received unexpected event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 for instance with vm_state active and task_state rebuilding.
Nov 10 16:19:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:45 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:48 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:48 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:19:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:19:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:19:48 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:19:48 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updating instance_info_cache with network_info: [{"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:19:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-cc9e365b-8b0a-40db-bbc4-026f609cdd7a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:19:48 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:19:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:19:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (sdc) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:19:52 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:19:52 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8291MB free_disk=25.583049774169922GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 83ad82f3-4e34-46fd-94a6-71adb8884eda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ab373f84-9ba6-4336-bca7-602464b61fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6458fc11-6612-4108-addd-ce61d935431e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 2c40f2a3-dbfb-497d-8ec3-df38105cad20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:19:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:19:54 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:19:54 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:19:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6aef325-8a9d-4083-8e52-34c4e5ff3cf7 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 93.771s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:20:03 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Creating image(s)
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Ensure instance console log exists: /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Start _get_guest_xml network_info=[{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6e87894e-183d-41c0-84fa-d5ddc996f029', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHzKvIqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '371a2928-c805-47e0-aeb8-e5140aac7b23', 'attached_at': '', 'detached_at': '', 'volume_id': '0c3a0a72-af1b-4b34-bdd7-127af133e488', 'serial': '0c3a0a72-af1b-4b34-bdd7-127af133e488'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:20:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:20:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHzKvIqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:03 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:03 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:03 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7af1a9ce-b136-4453-b24f-61a5c676c426]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:20:03 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e779f98f-1d28-44dc-b2e9-9eea8b5d1d05]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488] added
Nov 10 16:20:03 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f266775-5783-4990-906b-ec1114d3797a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b39dfa4-2f4c-4af6-b804-0c27bc0a0299]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHzKvIqm {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHzKvIqm" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e444e13b-8e3c-4407-868c-ef9282db0610]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EHzKvIqm'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5a047f-885b-4410-a8c0-9f1c947d7af7]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fdde8d-72d0-46b8-ac16-2f6ae75185a3]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae2821a0-5545-46bf-b712-f73fb8abd48f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488, portal: 172.16.0.220,3260]
Nov 10 16:20:03 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488, portal: 172.16.0.220,3260] successful.
Nov 10 16:20:03 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[04ee5e66-2394-48ea-abf3-b6e1764472d6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: INFO nova.compute.manager [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Detaching volume b6bcba7a-cd67-4243-87fd-4fa95722e753
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d07440-51e1-4477-a137-aebf78a57dc3]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:03 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.306s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] HCTL ('33', '-', '-', 0) found on session 7 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[141a897d-8b5c-4daf-bca8-17f471324a92]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching for a device in session 7 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHzKvIqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:20:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 6458fc11-6612-4108-addd-ce61d935431e could not be found.
Nov 10 16:20:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMVPuJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:03 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 16:20:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4ee6916e-79c4-4f6a-a0fe-ed9435b09aa4 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] volume_snapshot_create: create_info: {'snapshot_id': 'a250c06b-3998-4f8e-9de7-ccb61ea29891', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75102) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4ee6916e-79c4-4f6a-a0fe-ed9435b09aa4 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] snap xml: <domainsnapshot>
Nov 10 16:20:04 user nova-compute[75102]:   <disks>
Nov 10 16:20:04 user nova-compute[75102]:     <disk name="/dev/sdd" snapshot="external" type="file">
Nov 10 16:20:04 user nova-compute[75102]:       <source file="/dev/new_file"/>
Nov 10 16:20:04 user nova-compute[75102]:     </disk>
Nov 10 16:20:04 user nova-compute[75102]:     <disk name="vda" snapshot="no"/>
Nov 10 16:20:04 user nova-compute[75102]:   </disks>
Nov 10 16:20:04 user nova-compute[75102]: </domainsnapshot>
Nov 10 16:20:04 user nova-compute[75102]:  {{(pid=75102) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.objects.instance [None req-4ee6916e-79c4-4f6a-a0fe-ed9435b09aa4 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] Lazy-loading 'system_metadata' on Instance uuid 83ad82f3-4e34-46fd-94a6-71adb8884eda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:04 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4ee6916e-79c4-4f6a-a0fe-ed9435b09aa4 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [None req-4ee6916e-79c4-4f6a-a0fe-ed9435b09aa4 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Traceback (most recent call last):
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     rv = execute(f, *args, **kwargs)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     six.reraise(c, e, tb)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     raise value
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     rv = meth(*args, **kwargs)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] 
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [None req-4ee6916e-79c4-4f6a-a0fe-ed9435b09aa4 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Traceback (most recent call last):
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     self._volume_snapshot_create(context, instance, guest,
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     rv = execute(f, *args, **kwargs)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     six.reraise(c, e, tb)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     raise value
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     rv = meth(*args, **kwargs)
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] 
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cb8a4d6a-fe77-42b5-af16-9ae2a6de98f9 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] volume_snapshot_delete: delete_info: {'volume_id': '05532186-37ef-4e14-8ac6-e33aa6fd25e0'} {{(pid=75102) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [None req-cb8a4d6a-fe77-42b5-af16-9ae2a6de98f9 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Traceback (most recent call last):
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda]     if delete_info['type'] != 'qcow2':
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] KeyError: 'type'
Nov 10 16:20:04 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] 
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] <== connect_volume: return (1345ms) {'type': 'block', 'scsi_wwn': '23335656463346362', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335656463346362', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.716s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7672316c-d889-4f82-91f6-8d104ef9cec6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:20:04 user nova-compute[75102]: No targets found.
Nov 10 16:20:04 user nova-compute[75102]: iSNS:
Nov 10 16:20:04 user nova-compute[75102]: No targets found.
Nov 10 16:20:04 user nova-compute[75102]: STATIC:
Nov 10 16:20:04 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753
Nov 10 16:20:04 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:04 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:04 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4
Nov 10 16:20:04 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:04 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:04 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:20:04 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:04 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:04 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0
Nov 10 16:20:04 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:04 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:04 user nova-compute[75102]: FIRMWARE:
Nov 10 16:20:04 user nova-compute[75102]: No targets found.
Nov 10 16:20:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:20:04 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:20:04 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-736491098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-736491098',id=10,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-v0xb7v47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:18:53Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=371a2928-c805-47e0-aeb8-e5140aac7b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b9:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e334149-8bda-4d77-a44b-296a7ecf7a7d,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e334149-8b') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.objects.instance [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'pci_devices' on Instance uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1e66bcd-d8f4-4e55-bdde-86ed5dc19184]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:20:04 user nova-compute[75102]:   <uuid>371a2928-c805-47e0-aeb8-e5140aac7b23</uuid>
Nov 10 16:20:04 user nova-compute[75102]:   <name>instance-0000000a</name>
Nov 10 16:20:04 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:20:04 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:20:04 user nova-compute[75102]:   <metadata>
Nov 10 16:20:04 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:20:04 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:20:04 user nova-compute[75102]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-736491098</nova:name>
Nov 10 16:20:04 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:20:03</nova:creationTime>
Nov 10 16:20:04 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:20:04 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:20:04 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:20:04 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:20:04 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:20:04 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:20:04 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:20:04 user nova-compute[75102]:       <nova:owner>
Nov 10 16:20:04 user nova-compute[75102]:         <nova:user uuid="3149d0620bf64829aa4eec99a2cddee5">tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member</nova:user>
Nov 10 16:20:04 user nova-compute[75102]:         <nova:project uuid="c0e926f56f914e7488a50f5bb78a33cd">tempest-ServerBootFromVolumeStableRescueTest-918868864</nova:project>
Nov 10 16:20:04 user nova-compute[75102]:       </nova:owner>
Nov 10 16:20:04 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:20:04 user nova-compute[75102]:       <nova:ports>
Nov 10 16:20:04 user nova-compute[75102]:         <nova:port uuid="8e334149-8bda-4d77-a44b-296a7ecf7a7d">
Nov 10 16:20:04 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 16:20:04 user nova-compute[75102]:         </nova:port>
Nov 10 16:20:04 user nova-compute[75102]:       </nova:ports>
Nov 10 16:20:04 user nova-compute[75102]:     </nova:instance>
Nov 10 16:20:04 user nova-compute[75102]:   </metadata>
Nov 10 16:20:04 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:20:04 user nova-compute[75102]:     <system>
Nov 10 16:20:04 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:20:04 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:20:04 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:20:04 user nova-compute[75102]:       <entry name="serial">371a2928-c805-47e0-aeb8-e5140aac7b23</entry>
Nov 10 16:20:04 user nova-compute[75102]:       <entry name="uuid">371a2928-c805-47e0-aeb8-e5140aac7b23</entry>
Nov 10 16:20:04 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:20:04 user nova-compute[75102]:     </system>
Nov 10 16:20:04 user nova-compute[75102]:   </sysinfo>
Nov 10 16:20:04 user nova-compute[75102]:   <os>
Nov 10 16:20:04 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:20:04 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:20:04 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:20:04 user nova-compute[75102]:   </os>
Nov 10 16:20:04 user nova-compute[75102]:   <features>
Nov 10 16:20:04 user nova-compute[75102]:     <acpi/>
Nov 10 16:20:04 user nova-compute[75102]:     <apic/>
Nov 10 16:20:04 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:20:04 user nova-compute[75102]:   </features>
Nov 10 16:20:04 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:20:04 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:20:04 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:20:04 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:20:04 user nova-compute[75102]:   </clock>
Nov 10 16:20:04 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:20:04 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:20:04 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:20:04 user nova-compute[75102]:   </cpu>
Nov 10 16:20:04 user nova-compute[75102]:   <devices>
Nov 10 16:20:04 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:20:04 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:04 user nova-compute[75102]:       <source dev="/dev/sdb"/>
Nov 10 16:20:04 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:20:04 user nova-compute[75102]:       <serial>0c3a0a72-af1b-4b34-bdd7-127af133e488</serial>
Nov 10 16:20:04 user nova-compute[75102]:     </disk>
Nov 10 16:20:04 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:20:04 user nova-compute[75102]:       <mac address="fa:16:3e:20:b9:c7"/>
Nov 10 16:20:04 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:04 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:20:04 user nova-compute[75102]:       <target dev="tap8e334149-8b"/>
Nov 10 16:20:04 user nova-compute[75102]:     </interface>
Nov 10 16:20:04 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:20:04 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/console.log" append="off"/>
Nov 10 16:20:04 user nova-compute[75102]:     </serial>
Nov 10 16:20:04 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:20:04 user nova-compute[75102]:     <video>
Nov 10 16:20:04 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:04 user nova-compute[75102]:     </video>
Nov 10 16:20:04 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:20:04 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:20:04 user nova-compute[75102]:     </rng>
Nov 10 16:20:04 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:20:04 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:20:04 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:20:04 user nova-compute[75102]:     </memballoon>
Nov 10 16:20:04 user nova-compute[75102]:   </devices>
Nov 10 16:20:04 user nova-compute[75102]: </domain>
Nov 10 16:20:04 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-736491098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-736491098',id=10,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-v0xb7v47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:18:53Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=371a2928-c805-47e0-aeb8-e5140aac7b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:b9:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e334149-8bda-4d77-a44b-296a7ecf7a7d,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e334149-8b') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_vif [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b9:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e334149-8bda-4d77-a44b-296a7ecf7a7d,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e334149-8b') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3b08d3ae-e088-50e6-bf9c-2b656d03a151', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8e334149-8b, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8e334149-8b, col_values=(('qos', UUID('38600851-da06-4b8e-b6e5-ea60317258b9')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8e334149-8b, col_values=(('external_ids', {'iface-id': '8e334149-8bda-4d77-a44b-296a7ecf7a7d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:20:b9:c7', 'vm-uuid': '371a2928-c805-47e0-aeb8-e5140aac7b23'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[83e279ea-11a0-4261-ba56-3a8f300b6f33]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:04 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:04 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:04 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:04 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:04 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:04 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7449c430>, {}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Disconnecting from: [] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.096s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] <== disconnect_volume: return (813ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:04 user nova-compute[75102]: INFO os_vif [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:b9:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e334149-8bda-4d77-a44b-296a7ecf7a7d,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e334149-8b')
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:20:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No VIF found with MAC fa:16:3e:20:b9:c7, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [None req-4ee6916e-79c4-4f6a-a0fe-ed9435b09aa4 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot a250c06b-3998-4f8e-9de7-ccb61ea29891 could not be found.
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     raise value
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot a250c06b-3998-4f8e-9de7-ccb61ea29891 could not be found. (HTTP 404) (Request-ID: req-a8e3d209-4002-4a5d-bf7c-63bf51cd9d1d)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot a250c06b-3998-4f8e-9de7-ccb61ea29891 could not be found.
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server [None req-4ee6916e-79c4-4f6a-a0fe-ed9435b09aa4 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise value
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:20:05 user nova-compute[75102]: INFO nova.virt.block_device [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Attempting to driver detach volume b6bcba7a-cd67-4243-87fd-4fa95722e753 from mountpoint /dev/sdc
Nov 10 16:20:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Attempting to detach device sdc from instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:20:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:20:05 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:05 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:20:05 user nova-compute[75102]:   <target dev="sdc" bus="scsi"/>
Nov 10 16:20:05 user nova-compute[75102]:   <serial>b6bcba7a-cd67-4243-87fd-4fa95722e753</serial>
Nov 10 16:20:05 user nova-compute[75102]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 16:20:05 user nova-compute[75102]: </disk>
Nov 10 16:20:05 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:20:05 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Successfully detached device sdc from instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a from the persistent domain config.
Nov 10 16:20:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:20:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:20:05 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:05 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:20:05 user nova-compute[75102]:   <target dev="sdc" bus="scsi"/>
Nov 10 16:20:05 user nova-compute[75102]:   <serial>b6bcba7a-cd67-4243-87fd-4fa95722e753</serial>
Nov 10 16:20:05 user nova-compute[75102]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 10 16:20:05 user nova-compute[75102]: </disk>
Nov 10 16:20:05 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver [None req-cb8a4d6a-fe77-42b5-af16-9ae2a6de98f9 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-2aac77f9-b9cb-4bc7-acda-4af3242edb32)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 10 16:20:05 user nova-compute[75102]: ERROR nova.virt.libvirt.driver 
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server [None req-cb8a4d6a-fe77-42b5-af16-9ae2a6de98f9 tempest-VolumesAssistedSnapshotsTest-1498816630 tempest-VolumesAssistedSnapshotsTest-1498816630-project] Exception during message handling: KeyError: 'type'
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 10 16:20:05 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:20:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-06c1dc3d-dcf4-4e73-bdcb-43cd0869ff7d req-71d242af-db1b-4af5-90f8-3a5103a4f045 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-06c1dc3d-dcf4-4e73-bdcb-43cd0869ff7d req-71d242af-db1b-4af5-90f8-3a5103a4f045 service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-06c1dc3d-dcf4-4e73-bdcb-43cd0869ff7d req-71d242af-db1b-4af5-90f8-3a5103a4f045 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-06c1dc3d-dcf4-4e73-bdcb-43cd0869ff7d req-71d242af-db1b-4af5-90f8-3a5103a4f045 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-06c1dc3d-dcf4-4e73-bdcb-43cd0869ff7d req-71d242af-db1b-4af5-90f8-3a5103a4f045 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:06 user nova-compute[75102]: WARNING nova.compute.manager [req-06c1dc3d-dcf4-4e73-bdcb-43cd0869ff7d req-71d242af-db1b-4af5-90f8-3a5103a4f045 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state building and task_state spawning.
Nov 10 16:20:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:20:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:20:08 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Instance spawned successfully.
Nov 10 16:20:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:20:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8faebd75-7fe6-4458-a25b-a33226f02b30 req-a8f16914-edad-4016-a86a-30a73ea1943f service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8faebd75-7fe6-4458-a25b-a33226f02b30 req-a8f16914-edad-4016-a86a-30a73ea1943f service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8faebd75-7fe6-4458-a25b-a33226f02b30 req-a8f16914-edad-4016-a86a-30a73ea1943f service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8faebd75-7fe6-4458-a25b-a33226f02b30 req-a8f16914-edad-4016-a86a-30a73ea1943f service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8faebd75-7fe6-4458-a25b-a33226f02b30 req-a8f16914-edad-4016-a86a-30a73ea1943f service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:09 user nova-compute[75102]: WARNING nova.compute.manager [req-8faebd75-7fe6-4458-a25b-a33226f02b30 req-a8f16914-edad-4016-a86a-30a73ea1943f service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state building and task_state spawning.
Nov 10 16:20:09 user nova-compute[75102]: INFO nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 10 16:20:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:20:09 user nova-compute[75102]: INFO nova.compute.manager [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Took 76.81 seconds to build instance.
Nov 10 16:20:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7bbc504b-c4af-4d73-bfb6-71dd342f7e61 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 76.913s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkjGylce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:10 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:10 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:10 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9011bcb6-5f4e-488c-a3b9-9090d03c43b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:20:10 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c276f5-344d-4e06-bf9c-94a64ca32898]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b] added
Nov 10 16:20:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9940bb7a-8a19-4a67-b8ca-22e188eda10a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc5368d-7fa0-4bc4-a552-520319396764]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkjGylce {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vkjGylce" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[841280c7-f0e3-47b4-ba56-64297d35aba2]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vkjGylce'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8529206c-d72f-4481-9dcb-2f87f2bff48c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[687a1b47-c2dc-4d14-85db-3ad03630b561]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2514f57-b654-4ffa-a97e-79d4160c99ae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b, portal: 172.16.0.220,3260]
Nov 10 16:20:10 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b, portal: 172.16.0.220,3260] successful.
Nov 10 16:20:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ed97cb-6f6c-4963-bf09-0c34905ac210]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba97a290-8fcb-45bc-b43e-dd9413129e69]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:10 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] HCTL ('37', '-', '-', 0) found on session 8 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7f8b5d-d8ff-4e2f-ba41-58bf5e212654]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Searching for a device in session 8 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkjGylce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:10 user nova-compute[75102]: INFO nova.compute.manager [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Detaching volume 05532186-37ef-4e14-8ac6-e33aa6fd25e0
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:10 user nova-compute[75102]: INFO nova.compute.manager [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Detaching volume df7e03fe-e51a-4167-a5c0-d4e05cf620d4
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:10 user nova-compute[75102]: DEBUG nova.objects.instance [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lazy-loading 'flavor' on Instance uuid 731624eb-b0c0-42c1-80cf-2dd76932e92a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:11 user nova-compute[75102]: INFO nova.virt.block_device [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Attempting to driver detach volume 05532186-37ef-4e14-8ac6-e33aa6fd25e0 from mountpoint /dev/vdb
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Attempting to detach device vdb from instance 83ad82f3-4e34-46fd-94a6-71adb8884eda from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 16:20:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:11 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:20:11 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:20:11 user nova-compute[75102]:   <serial>05532186-37ef-4e14-8ac6-e33aa6fd25e0</serial>
Nov 10 16:20:11 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:20:11 user nova-compute[75102]: </disk>
Nov 10 16:20:11 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:20:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Successfully detached device vdb from instance 83ad82f3-4e34-46fd-94a6-71adb8884eda from the persistent domain config.
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 83ad82f3-4e34-46fd-94a6-71adb8884eda from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] detach device xml: <disk type="block" device="disk">
Nov 10 16:20:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:11 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:20:11 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:20:11 user nova-compute[75102]:   <serial>05532186-37ef-4e14-8ac6-e33aa6fd25e0</serial>
Nov 10 16:20:11 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:20:11 user nova-compute[75102]: </disk>
Nov 10 16:20:11 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:20:11 user nova-compute[75102]: INFO nova.virt.block_device [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Attempting to driver detach volume df7e03fe-e51a-4167-a5c0-d4e05cf620d4 from mountpoint /dev/vdb
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Attempting to detach device vdb from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:20:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:11 user nova-compute[75102]:   <source dev="/dev/sde"/>
Nov 10 16:20:11 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:20:11 user nova-compute[75102]:   <serial>df7e03fe-e51a-4167-a5c0-d4e05cf620d4</serial>
Nov 10 16:20:11 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 16:20:11 user nova-compute[75102]: </disk>
Nov 10 16:20:11 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:20:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Successfully detached device vdb from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 from the persistent domain config.
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:20:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:11 user nova-compute[75102]:   <source dev="/dev/sde"/>
Nov 10 16:20:11 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:20:11 user nova-compute[75102]:   <serial>df7e03fe-e51a-4167-a5c0-d4e05cf620d4</serial>
Nov 10 16:20:11 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 16:20:11 user nova-compute[75102]: </disk>
Nov 10 16:20:11 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:11 user nova-compute[75102]: INFO nova.compute.manager [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Attaching volume 16c3c027-57d4-46aa-a334-ac1fbdf77788 to /dev/vdb
Nov 10 16:20:11 user nova-compute[75102]: DEBUG os_brick.utils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa0af3e-bdba-4005-b6cf-975a593271a5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd62a5b-0e7f-447c-9414-ef8f0653b09c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[94388516-1251-4f48-8c2d-7d01fa833a3b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[359b6f71-e3cb-4678-95e4-8fb20244c10f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Preparing to wait for external event volume-reimaged-aefc9e87-7a41-45fe-97a7-113f4a673159 {{(pid=75102) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 83ad82f3-4e34-46fd-94a6-71adb8884eda {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:20:11 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:20:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed0c954c-1acb-481e-a528-6ae8f6dd399c]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG os_brick.utils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating existing volume attachment record: b0961d28-22f4-4556-9fcf-bf0fde52b8cd {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.346s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] <== connect_volume: return (1347ms) {'type': 'block', 'scsi_wwn': '23937653338366666', 'path': '/dev/sdf'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23937653338366666', 'path': '/dev/sdf'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.objects.instance [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lazy-loading 'flavor' on Instance uuid ab373f84-9ba6-4336-bca7-602464b61fb3 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:20:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:11 user nova-compute[75102]:   <source dev="/dev/sdf"/>
Nov 10 16:20:11 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:20:11 user nova-compute[75102]:   <serial>ee18ac51-e08b-4fa4-9a53-1bdd104cd65b</serial>
Nov 10 16:20:11 user nova-compute[75102]: </disk>
Nov 10 16:20:11 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:20:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:20:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:20:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:20:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] No VIF found with MAC fa:16:3e:c5:fc:2c, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:20:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2a8aa9aa-9410-4120-8648-acc76df787f3 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 103.742s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG os_brick.utils [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b0186d-0697-4dc1-adca-ca10f6cb27ba]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdd05275-493b-49aa-9470-68e1e6d27468]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a438752-dbfd-486e-992f-ce8c298f5952]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b69023-fe6a-4488-9859-2500ac09933a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:20:13 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:20:13 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3dba8b9-aaa1-4457-bde8-1162b2dd0277]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:20:13 user nova-compute[75102]: DEBUG os_brick.utils [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:13 user nova-compute[75102]: INFO nova.compute.manager [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Swapping volume ee18ac51-e08b-4fa4-9a53-1bdd104cd65b for 6324edb8-26fd-441c-8a95-f42af6529431
Nov 10 16:20:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:20:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:20:18 user nova-compute[75102]: INFO nova.compute.claims [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Claim successful on node user
Nov 10 16:20:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:18 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:20:18 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:20:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:20:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG nova.policy [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95ef5e9028c34d61b880bff813a53216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d408293bc34453b58b852baca77d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:20:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Creating image(s)
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "/opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "/opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "/opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk 1073741824" returned: 0 in 0.067s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.251s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Successfully created port: d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.188s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:20:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Cannot resize image /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Ensure instance console log exists: /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Successfully updated port: d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquired lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-8fd5c840-a2ba-41b9-ac94-4a9a5caba430 req-5e83b6c5-d46c-42af-a9a3-a77eecd268e0 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received event network-changed-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-8fd5c840-a2ba-41b9-ac94-4a9a5caba430 req-5e83b6c5-d46c-42af-a9a3-a77eecd268e0 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Refreshing instance network info cache due to event network-changed-d798edb0-43db-4e57-a080-2ea4db4bd5a3. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8fd5c840-a2ba-41b9-ac94-4a9a5caba430 req-5e83b6c5-d46c-42af-a9a3-a77eecd268e0 service nova] Acquiring lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Updating instance_info_cache with network_info: [{"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Releasing lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Instance network_info: |[{"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8fd5c840-a2ba-41b9-ac94-4a9a5caba430 req-5e83b6c5-d46c-42af-a9a3-a77eecd268e0 service nova] Acquired lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-8fd5c840-a2ba-41b9-ac94-4a9a5caba430 req-5e83b6c5-d46c-42af-a9a3-a77eecd268e0 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Refreshing network info cache for port d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Start _get_guest_xml network_info=[{"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:20:20 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:20:20 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628681901',display_name='tempest-AttachVolumeTestJSON-server-1628681901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628681901',id=11,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOzhYwARGmPnCAHQDJ07hSoBoKeoFloAP8BhLbfxMfb6sWEIlcFO1RXTqP2h1BHkDvNmjRB7M3l+o5n3w3nq4ej0zNo/bOHuPMw8rt+UxzA+FRn9gpytId1gJhViL+mQg==',key_name='tempest-keypair-332246158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d408293bc34453b58b852baca77d35',ramdisk_id='',reservation_id='r-v941j3bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1946940767',owner_user_name='tempest-AttachVolumeTestJSON-1946940767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95ef5e9028c34d61b880bff813a53216',uuid=a8562537-34e2-45eb-835c-a4dd59e3af7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converting VIF {"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f9:bb,bridge_name='br-int',has_traffic_filtering=True,id=d798edb0-43db-4e57-a080-2ea4db4bd5a3,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd798edb0-43') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.objects.instance [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'pci_devices' on Instance uuid a8562537-34e2-45eb-835c-a4dd59e3af7c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:20:20 user nova-compute[75102]:   <uuid>a8562537-34e2-45eb-835c-a4dd59e3af7c</uuid>
Nov 10 16:20:20 user nova-compute[75102]:   <name>instance-0000000b</name>
Nov 10 16:20:20 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:20:20 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:20:20 user nova-compute[75102]:   <metadata>
Nov 10 16:20:20 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:20:20 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:20:20 user nova-compute[75102]:       <nova:name>tempest-AttachVolumeTestJSON-server-1628681901</nova:name>
Nov 10 16:20:20 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:20:20</nova:creationTime>
Nov 10 16:20:20 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:20:20 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:20:20 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:20:20 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:20:20 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:20:20 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:20:20 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:20:20 user nova-compute[75102]:       <nova:owner>
Nov 10 16:20:20 user nova-compute[75102]:         <nova:user uuid="95ef5e9028c34d61b880bff813a53216">tempest-AttachVolumeTestJSON-1946940767-project-member</nova:user>
Nov 10 16:20:20 user nova-compute[75102]:         <nova:project uuid="d6d408293bc34453b58b852baca77d35">tempest-AttachVolumeTestJSON-1946940767</nova:project>
Nov 10 16:20:20 user nova-compute[75102]:       </nova:owner>
Nov 10 16:20:20 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:20:20 user nova-compute[75102]:       <nova:ports>
Nov 10 16:20:20 user nova-compute[75102]:         <nova:port uuid="d798edb0-43db-4e57-a080-2ea4db4bd5a3">
Nov 10 16:20:20 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:20:20 user nova-compute[75102]:         </nova:port>
Nov 10 16:20:20 user nova-compute[75102]:       </nova:ports>
Nov 10 16:20:20 user nova-compute[75102]:     </nova:instance>
Nov 10 16:20:20 user nova-compute[75102]:   </metadata>
Nov 10 16:20:20 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:20:20 user nova-compute[75102]:     <system>
Nov 10 16:20:20 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:20:20 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:20:20 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:20:20 user nova-compute[75102]:       <entry name="serial">a8562537-34e2-45eb-835c-a4dd59e3af7c</entry>
Nov 10 16:20:20 user nova-compute[75102]:       <entry name="uuid">a8562537-34e2-45eb-835c-a4dd59e3af7c</entry>
Nov 10 16:20:20 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:20:20 user nova-compute[75102]:     </system>
Nov 10 16:20:20 user nova-compute[75102]:   </sysinfo>
Nov 10 16:20:20 user nova-compute[75102]:   <os>
Nov 10 16:20:20 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:20:20 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:20:20 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:20:20 user nova-compute[75102]:   </os>
Nov 10 16:20:20 user nova-compute[75102]:   <features>
Nov 10 16:20:20 user nova-compute[75102]:     <acpi/>
Nov 10 16:20:20 user nova-compute[75102]:     <apic/>
Nov 10 16:20:20 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:20:20 user nova-compute[75102]:   </features>
Nov 10 16:20:20 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:20:20 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:20:20 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:20:20 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:20:20 user nova-compute[75102]:   </clock>
Nov 10 16:20:20 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:20:20 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:20:20 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:20:20 user nova-compute[75102]:   </cpu>
Nov 10 16:20:20 user nova-compute[75102]:   <devices>
Nov 10 16:20:20 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:20:20 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:20:20 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk"/>
Nov 10 16:20:20 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:20:20 user nova-compute[75102]:     </disk>
Nov 10 16:20:20 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:20:20 user nova-compute[75102]:       <mac address="fa:16:3e:4f:f9:bb"/>
Nov 10 16:20:20 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:20 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:20:20 user nova-compute[75102]:       <target dev="tapd798edb0-43"/>
Nov 10 16:20:20 user nova-compute[75102]:     </interface>
Nov 10 16:20:20 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:20:20 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/console.log" append="off"/>
Nov 10 16:20:20 user nova-compute[75102]:     </serial>
Nov 10 16:20:20 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:20:20 user nova-compute[75102]:     <video>
Nov 10 16:20:20 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:20 user nova-compute[75102]:     </video>
Nov 10 16:20:20 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:20:20 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:20:20 user nova-compute[75102]:     </rng>
Nov 10 16:20:20 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:20:20 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:20:20 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:20:20 user nova-compute[75102]:     </memballoon>
Nov 10 16:20:20 user nova-compute[75102]:   </devices>
Nov 10 16:20:20 user nova-compute[75102]: </domain>
Nov 10 16:20:20 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628681901',display_name='tempest-AttachVolumeTestJSON-server-1628681901',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628681901',id=11,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOzhYwARGmPnCAHQDJ07hSoBoKeoFloAP8BhLbfxMfb6sWEIlcFO1RXTqP2h1BHkDvNmjRB7M3l+o5n3w3nq4ej0zNo/bOHuPMw8rt+UxzA+FRn9gpytId1gJhViL+mQg==',key_name='tempest-keypair-332246158',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d408293bc34453b58b852baca77d35',ramdisk_id='',reservation_id='r-v941j3bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1946940767',owner_user_name='tempest-AttachVolumeTestJSON-1946940767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:20:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95ef5e9028c34d61b880bff813a53216',uuid=a8562537-34e2-45eb-835c-a4dd59e3af7c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converting VIF {"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f9:bb,bridge_name='br-int',has_traffic_filtering=True,id=d798edb0-43db-4e57-a080-2ea4db4bd5a3,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd798edb0-43') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG os_vif [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f9:bb,bridge_name='br-int',has_traffic_filtering=True,id=d798edb0-43db-4e57-a080-2ea4db4bd5a3,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd798edb0-43') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1311c386-ccbc-5cd4-b7af-583852ad0e02', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd798edb0-43, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd798edb0-43, col_values=(('qos', UUID('33ba90bb-c180-45eb-821b-939edf2a1345')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd798edb0-43, col_values=(('external_ids', {'iface-id': 'd798edb0-43db-4e57-a080-2ea4db4bd5a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:f9:bb', 'vm-uuid': 'a8562537-34e2-45eb-835c-a4dd59e3af7c'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:20 user nova-compute[75102]: INFO os_vif [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:f9:bb,bridge_name='br-int',has_traffic_filtering=True,id=d798edb0-43db-4e57-a080-2ea4db4bd5a3,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd798edb0-43')
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:20:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No VIF found with MAC fa:16:3e:4f:f9:bb, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:20:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-8fd5c840-a2ba-41b9-ac94-4a9a5caba430 req-5e83b6c5-d46c-42af-a9a3-a77eecd268e0 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Updated VIF entry in instance network info cache for port d798edb0-43db-4e57-a080-2ea4db4bd5a3. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:20:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-8fd5c840-a2ba-41b9-ac94-4a9a5caba430 req-5e83b6c5-d46c-42af-a9a3-a77eecd268e0 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Updating instance_info_cache with network_info: [{"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:20:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8fd5c840-a2ba-41b9-ac94-4a9a5caba430 req-5e83b6c5-d46c-42af-a9a3-a77eecd268e0 service nova] Releasing lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:20:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-eb4a81d4-c13d-4df8-93e3-f489c2fafaf8 req-ec735d7f-5770-4bc8-a56d-033717bd0abe service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received event network-vif-plugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb4a81d4-c13d-4df8-93e3-f489c2fafaf8 req-ec735d7f-5770-4bc8-a56d-033717bd0abe service nova] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb4a81d4-c13d-4df8-93e3-f489c2fafaf8 req-ec735d7f-5770-4bc8-a56d-033717bd0abe service nova] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb4a81d4-c13d-4df8-93e3-f489c2fafaf8 req-ec735d7f-5770-4bc8-a56d-033717bd0abe service nova] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-eb4a81d4-c13d-4df8-93e3-f489c2fafaf8 req-ec735d7f-5770-4bc8-a56d-033717bd0abe service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] No waiting events found dispatching network-vif-plugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:22 user nova-compute[75102]: WARNING nova.compute.manager [req-eb4a81d4-c13d-4df8-93e3-f489c2fafaf8 req-ec735d7f-5770-4bc8-a56d-033717bd0abe service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received unexpected event network-vif-plugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 for instance with vm_state building and task_state spawning.
Nov 10 16:20:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:20:23 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Creating image(s)
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Ensure instance console log exists: /opt/stack/data/nova/instances/2c40f2a3-dbfb-497d-8ec3-df38105cad20/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Start _get_guest_xml network_info=[{"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'd3086e27-2bef-4f1a-8031-587c013e094a', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqyNrRIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c40f2a3-dbfb-497d-8ec3-df38105cad20', 'attached_at': '', 'detached_at': '', 'volume_id': '3e4bc73d-8513-446f-ae00-b5d4b697d1da', 'serial': '3e4bc73d-8513-446f-ae00-b5d4b697d1da'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': 'be363b1d-3cb2-44da-a21f-4daf7005ccd8', 'boot_index': 1, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJtGvrXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c40f2a3-dbfb-497d-8ec3-df38105cad20', 'attached_at': '', 'detached_at': '', 'volume_id': '5f540661-66a9-48fb-9f99-56e935034a1e', 'serial': '5f540661-66a9-48fb-9f99-56e935034a1e'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None}, {'attachment_id': '27af1261-b1ff-49b9-ac8b-0361cd815125', 'boot_index': 2, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VyLNpSdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2c40f2a3-dbfb-497d-8ec3-df38105cad20', 'attached_at': '', 'detached_at': '', 'volume_id': '2a40ac1e-af7b-4a08-99b8-448c9a463f22', 'serial': '2a40ac1e-af7b-4a08-99b8-448c9a463f22'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:20:23 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:20:23 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqyNrRIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:23 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:23 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:23 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff9d78ce-345c-484f-ba53-a14098889776]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:20:23 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bae9f2d-0fa3-4421-95f7-8f6b42a9d84a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da] added
Nov 10 16:20:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8894126d-73f8-4645-9e4d-0be7c1116744]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d483e47-c525-4537-9b83-c9bf6ef5cd76]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqyNrRIG {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wqyNrRIG" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc7d95e-2386-4dd1-bc31-44e932a5f9a0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wqyNrRIG'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8cb95d-f811-45be-92e2-aad46bdc870b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[27fb6925-dd8a-4cf0-855c-826d14b145ed]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:23 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:23 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:23 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:23 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:23 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:23 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:23 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:23 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b48a26fa-6c72-4b06-b231-0fd3326a183d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da, portal: 172.16.0.220,3260]
Nov 10 16:20:23 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da, portal: 172.16.0.220,3260] successful.
Nov 10 16:20:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd9d9a1-b15e-49c4-a474-3b12d6a3d432]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cee7533-09f3-46b1-aff9-4ed06d721be9]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:24 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.344s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] HCTL ('38', '-', '-', 0) found on session 9 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[213f010f-68ed-43fa-be97-a70aab06a1aa]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Searching for a device in session 9 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqyNrRIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-2ef3bc67-2f76-4177-a9ce-c73835d18a21 req-93c06808-1bf3-4f5e-86f4-120cf825801b service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received event network-vif-plugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2ef3bc67-2f76-4177-a9ce-c73835d18a21 req-93c06808-1bf3-4f5e-86f4-120cf825801b service nova] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2ef3bc67-2f76-4177-a9ce-c73835d18a21 req-93c06808-1bf3-4f5e-86f4-120cf825801b service nova] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2ef3bc67-2f76-4177-a9ce-c73835d18a21 req-93c06808-1bf3-4f5e-86f4-120cf825801b service nova] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-2ef3bc67-2f76-4177-a9ce-c73835d18a21 req-93c06808-1bf3-4f5e-86f4-120cf825801b service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] No waiting events found dispatching network-vif-plugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:24 user nova-compute[75102]: WARNING nova.compute.manager [req-2ef3bc67-2f76-4177-a9ce-c73835d18a21 req-93c06808-1bf3-4f5e-86f4-120cf825801b service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received unexpected event network-vif-plugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 for instance with vm_state building and task_state spawning.
Nov 10 16:20:24 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Instance spawned successfully.
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:24 user nova-compute[75102]: INFO nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 10 16:20:24 user nova-compute[75102]: DEBUG nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:20:24 user nova-compute[75102]: INFO nova.compute.manager [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Took 6.59 seconds to build instance.
Nov 10 16:20:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-922eb83b-30e2-4be7-963c-8f67d465c075 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.718s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.394s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] <== connect_volume: return (1396ms) {'type': 'block', 'scsi_wwn': '26463663764333265', 'path': '/dev/sdg'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463663764333265', 'path': '/dev/sdg'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJtGvrXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:25 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:25 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:25 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f31862-6a76-4d55-b3a9-525db2f889f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:20:25 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e708fa1a-9403-46de-b7ed-253a7f1a98b0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e] added
Nov 10 16:20:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2be9ea-bd4f-42a0-9569-ad455b12ffd0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[077f04d7-281d-465b-911f-c51202ca1b26]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJtGvrXj {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZJtGvrXj" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeedb55b-788c-432d-a9eb-f0897746e7a3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZJtGvrXj'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d853a9-8347-4348-bc29-0b979f9d5d23]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c68467a-6022-4aea-bd92-e203a633bb38]: (4, ('tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsi session list stdout=tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76a6a64-3bf1-4c3c-8418-c842ce96aa84]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e, portal: 172.16.0.220,3260]
Nov 10 16:20:25 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e, portal: 172.16.0.220,3260] successful.
Nov 10 16:20:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d76f05cb-2aa6-409b-9e2d-a6e232086a62]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a172d9-2d72-457a-b581-22bde06cd316]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:25 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.334s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] HCTL ('39', '-', '-', 0) found on session 10 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[626f08a9-b68b-4e22-8979-2006e62d7f55]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Searching for a device in session 10 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJtGvrXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:20:25 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a is timed out.
Nov 10 16:20:25 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Successfully detached device sdc from instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a from the live domain config.
Nov 10 16:20:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jBwaTgUM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:25 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.375s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23766633731343133', 'path': '/dev/sdh'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23766633731343133', 'path': '/dev/sdh'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.773s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee0ac8a-fb46-4e80-91a7-31a5f8b04715]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:20:26 user nova-compute[75102]: No targets found.
Nov 10 16:20:26 user nova-compute[75102]: iSNS:
Nov 10 16:20:26 user nova-compute[75102]: No targets found.
Nov 10 16:20:26 user nova-compute[75102]: STATIC:
Nov 10 16:20:26 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753
Nov 10 16:20:26 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:26 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:26 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da
Nov 10 16:20:26 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:26 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:26 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4
Nov 10 16:20:26 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:26 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:26 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:20:26 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:26 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:26 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:20:26 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:26 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:26 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0
Nov 10 16:20:26 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:26 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:26 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e
Nov 10 16:20:26 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:26 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:26 user nova-compute[75102]: FIRMWARE:
Nov 10 16:20:26 user nova-compute[75102]: No targets found.
Nov 10 16:20:26 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:20:26 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:20:26 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VyLNpSdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:26 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1d245c-eb86-43e2-99b5-f80d8de48a85]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c2f5b6f-d502-4667-9074-4f5cbc8478b2]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:26 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:26 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:26 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74476d40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe87522b-be55-4b91-969e-13233e765dba]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc9699e-b859-4c64-b534-7731f16c8369]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e91cda5-eb30-4644-8bff-bbab833ebc25]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22d5414-5df4-47e9-a59d-5f707f828a2f]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5bf41c6-240a-45f7-bde4-16672b2b88ae]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf5fa61-7de8-4e1d-9756-c6b1a63f924c]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753, portal: 172.16.0.220,3260]
Nov 10 16:20:26 user nova-compute[75102]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753, portal: 172.16.0.220,3260] successful.
Nov 10 16:20:26 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b6bcba7a-cd67-4243-87fd-4fa95722e753 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b34087e9-262f-4729-9d78-28785d7704ae]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.384s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] <== disconnect_volume: return (1157ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.344s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:26 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:26 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0a526b-ff17-4be1-a768-15d43ca8ce85]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:20:26 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0337f1ab-32bc-4c4c-9b6b-85af3704fadd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22] added
Nov 10 16:20:26 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[631eb2b2-1825-41cf-9f22-d619488c4155]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f959d7b2-fd62-4d45-8b93-c5fa39c0901d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VyLNpSdr {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v VyLNpSdr" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0086f8a-2173-4dbe-994e-191a26afd32b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'VyLNpSdr'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d7f3d6-897c-4ddc-90df-45e31ad14ade]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2be05b-5952-4368-a9b4-38713a32f674]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --login" returned: 0 in 0.106s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee1dcf6-8f8f-4915-b4b0-fca9efa63a51]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22, portal: 172.16.0.220,3260]
Nov 10 16:20:27 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22, portal: 172.16.0.220,3260] successful.
Nov 10 16:20:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb7a7b57-e3b0-4306-8073-15a224014001]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fd4eff-4ceb-4ddf-b607-a95c6bbfa2ba]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:27 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] HCTL ('34', '-', '-', 0) found on session 11 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b57a59e-6d1b-4ef6-a7be-f0eb159053a4]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Searching for a device in session 11 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:20:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VyLNpSdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.objects.instance [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lazy-loading 'flavor' on Instance uuid cc9e365b-8b0a-40db-bbc4-026f609cdd7a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0e0b2965-05cf-4671-b2b0-4ebfcb2926da tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 24.565s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] <== connect_volume: return (1764ms) {'type': 'block', 'scsi_wwn': '23334666339363034', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334666339363034', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=39c985ac-2f47-482e-8376-5a0d6531bbd4,network=Network(ba224a99-36e3-41e7-9680-2706ddbc2be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c985ac-2f') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:cd,bridge_name='br-int',has_traffic_filtering=True,id=3158e32f-b3dc-4bbf-878e-dcb004f642a3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3158e32f-b3') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=ba625408-a772-4626-82a3-b411c917d6cd,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba625408-a7') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b83d6e13-aa0f-4815-8b3e-91e003b2b136,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d6e13-aa') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=03e161ba-5708-40fa-96d1-895fbaf95ca3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e161ba-57') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b4412faa-9961-4fa7-9993-76a00afbe6b6,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4412faa-99') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1c:e5,bridge_name='br-int',has_traffic_filtering=True,id=a0215f7d-3a99-4c69-af70-d886b84dcc36,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0215f7d-3a') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c40f2a3-dbfb-497d-8ec3-df38105cad20 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:20:28 user nova-compute[75102]:   <uuid>2c40f2a3-dbfb-497d-8ec3-df38105cad20</uuid>
Nov 10 16:20:28 user nova-compute[75102]:   <name>instance-00000009</name>
Nov 10 16:20:28 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:20:28 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:20:28 user nova-compute[75102]:   <metadata>
Nov 10 16:20:28 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:20:28 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:20:28 user nova-compute[75102]:       <nova:name>tempest-device-tagging-server-1842012506</nova:name>
Nov 10 16:20:28 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:20:23</nova:creationTime>
Nov 10 16:20:28 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:20:28 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:20:28 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:20:28 user nova-compute[75102]:       <nova:owner>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:user uuid="7158e1b0077b4cdfaf14fe39a43fafa7">tempest-TaggedBootDevicesTest-603901565-project-member</nova:user>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:project uuid="3ce93c56e5e943789f4178c52523a81c">tempest-TaggedBootDevicesTest-603901565</nova:project>
Nov 10 16:20:28 user nova-compute[75102]:       </nova:owner>
Nov 10 16:20:28 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:20:28 user nova-compute[75102]:       <nova:ports>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:port uuid="39c985ac-2f47-482e-8376-5a0d6531bbd4">
Nov 10 16:20:28 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 16:20:28 user nova-compute[75102]:         </nova:port>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:port uuid="3158e32f-b3dc-4bbf-878e-dcb004f642a3">
Nov 10 16:20:28 user nova-compute[75102]:           <nova:ip type="fixed" address="10.1.1.211" ipVersion="4"/>
Nov 10 16:20:28 user nova-compute[75102]:         </nova:port>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:port uuid="ba625408-a772-4626-82a3-b411c917d6cd">
Nov 10 16:20:28 user nova-compute[75102]:           <nova:ip type="fixed" address="10.1.1.32" ipVersion="4"/>
Nov 10 16:20:28 user nova-compute[75102]:         </nova:port>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:port uuid="b83d6e13-aa0f-4815-8b3e-91e003b2b136">
Nov 10 16:20:28 user nova-compute[75102]:           <nova:ip type="fixed" address="10.1.1.11" ipVersion="4"/>
Nov 10 16:20:28 user nova-compute[75102]:         </nova:port>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:port uuid="03e161ba-5708-40fa-96d1-895fbaf95ca3">
Nov 10 16:20:28 user nova-compute[75102]:           <nova:ip type="fixed" address="10.1.1.36" ipVersion="4"/>
Nov 10 16:20:28 user nova-compute[75102]:         </nova:port>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:port uuid="b4412faa-9961-4fa7-9993-76a00afbe6b6">
Nov 10 16:20:28 user nova-compute[75102]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 10 16:20:28 user nova-compute[75102]:         </nova:port>
Nov 10 16:20:28 user nova-compute[75102]:         <nova:port uuid="a0215f7d-3a99-4c69-af70-d886b84dcc36">
Nov 10 16:20:28 user nova-compute[75102]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 10 16:20:28 user nova-compute[75102]:         </nova:port>
Nov 10 16:20:28 user nova-compute[75102]:       </nova:ports>
Nov 10 16:20:28 user nova-compute[75102]:     </nova:instance>
Nov 10 16:20:28 user nova-compute[75102]:   </metadata>
Nov 10 16:20:28 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:20:28 user nova-compute[75102]:     <system>
Nov 10 16:20:28 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:20:28 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:20:28 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:20:28 user nova-compute[75102]:       <entry name="serial">2c40f2a3-dbfb-497d-8ec3-df38105cad20</entry>
Nov 10 16:20:28 user nova-compute[75102]:       <entry name="uuid">2c40f2a3-dbfb-497d-8ec3-df38105cad20</entry>
Nov 10 16:20:28 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:20:28 user nova-compute[75102]:     </system>
Nov 10 16:20:28 user nova-compute[75102]:   </sysinfo>
Nov 10 16:20:28 user nova-compute[75102]:   <os>
Nov 10 16:20:28 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:20:28 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:20:28 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:20:28 user nova-compute[75102]:   </os>
Nov 10 16:20:28 user nova-compute[75102]:   <features>
Nov 10 16:20:28 user nova-compute[75102]:     <acpi/>
Nov 10 16:20:28 user nova-compute[75102]:     <apic/>
Nov 10 16:20:28 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:20:28 user nova-compute[75102]:   </features>
Nov 10 16:20:28 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:20:28 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:20:28 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:20:28 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:20:28 user nova-compute[75102]:   </clock>
Nov 10 16:20:28 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:20:28 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:20:28 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:20:28 user nova-compute[75102]:   </cpu>
Nov 10 16:20:28 user nova-compute[75102]:   <devices>
Nov 10 16:20:28 user nova-compute[75102]:     <disk type="file" device="cdrom">
Nov 10 16:20:28 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none"/>
Nov 10 16:20:28 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/2c40f2a3-dbfb-497d-8ec3-df38105cad20/disk.config"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="hda" bus="ide"/>
Nov 10 16:20:28 user nova-compute[75102]:     </disk>
Nov 10 16:20:28 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:20:28 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:28 user nova-compute[75102]:       <source dev="/dev/sdg"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <serial>3e4bc73d-8513-446f-ae00-b5d4b697d1da</serial>
Nov 10 16:20:28 user nova-compute[75102]:     </disk>
Nov 10 16:20:28 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:20:28 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:28 user nova-compute[75102]:       <source dev="/dev/sdh"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <serial>5f540661-66a9-48fb-9f99-56e935034a1e</serial>
Nov 10 16:20:28 user nova-compute[75102]:     </disk>
Nov 10 16:20:28 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:20:28 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:20:28 user nova-compute[75102]:       <source dev="/dev/sdc"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="vdc" bus="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <serial>2a40ac1e-af7b-4a08-99b8-448c9a463f22</serial>
Nov 10 16:20:28 user nova-compute[75102]:     </disk>
Nov 10 16:20:28 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:20:28 user nova-compute[75102]:       <mac address="fa:16:3e:44:64:d0"/>
Nov 10 16:20:28 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="tap39c985ac-2f"/>
Nov 10 16:20:28 user nova-compute[75102]:     </interface>
Nov 10 16:20:28 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:20:28 user nova-compute[75102]:       <mac address="fa:16:3e:c5:a5:cd"/>
Nov 10 16:20:28 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="tap3158e32f-b3"/>
Nov 10 16:20:28 user nova-compute[75102]:     </interface>
Nov 10 16:20:28 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:20:28 user nova-compute[75102]:       <mac address="fa:16:3e:17:cd:06"/>
Nov 10 16:20:28 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="tapba625408-a7"/>
Nov 10 16:20:28 user nova-compute[75102]:     </interface>
Nov 10 16:20:28 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:20:28 user nova-compute[75102]:       <mac address="fa:16:3e:98:14:b8"/>
Nov 10 16:20:28 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="tapb83d6e13-aa"/>
Nov 10 16:20:28 user nova-compute[75102]:     </interface>
Nov 10 16:20:28 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:20:28 user nova-compute[75102]:       <mac address="fa:16:3e:d9:45:9e"/>
Nov 10 16:20:28 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="tap03e161ba-57"/>
Nov 10 16:20:28 user nova-compute[75102]:     </interface>
Nov 10 16:20:28 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:20:28 user nova-compute[75102]:       <mac address="fa:16:3e:bb:b0:5a"/>
Nov 10 16:20:28 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="tapb4412faa-99"/>
Nov 10 16:20:28 user nova-compute[75102]:     </interface>
Nov 10 16:20:28 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:20:28 user nova-compute[75102]:       <mac address="fa:16:3e:cd:1c:e5"/>
Nov 10 16:20:28 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:20:28 user nova-compute[75102]:       <target dev="tapa0215f7d-3a"/>
Nov 10 16:20:28 user nova-compute[75102]:     </interface>
Nov 10 16:20:28 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:20:28 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/2c40f2a3-dbfb-497d-8ec3-df38105cad20/console.log" append="off"/>
Nov 10 16:20:28 user nova-compute[75102]:     </serial>
Nov 10 16:20:28 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:20:28 user nova-compute[75102]:     <video>
Nov 10 16:20:28 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:20:28 user nova-compute[75102]:     </video>
Nov 10 16:20:28 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:20:28 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:20:28 user nova-compute[75102]:     </rng>
Nov 10 16:20:28 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:20:28 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:20:28 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:20:28 user nova-compute[75102]:     </memballoon>
Nov 10 16:20:28 user nova-compute[75102]:   </devices>
Nov 10 16:20:28 user nova-compute[75102]: </domain>
Nov 10 16:20:28 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=39c985ac-2f47-482e-8376-5a0d6531bbd4,network=Network(ba224a99-36e3-41e7-9680-2706ddbc2be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c985ac-2f') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=39c985ac-2f47-482e-8376-5a0d6531bbd4,network=Network(ba224a99-36e3-41e7-9680-2706ddbc2be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c985ac-2f') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '152632f2-e067-5bee-be26-7d1b711f186a', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap39c985ac-2f, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap39c985ac-2f, col_values=(('qos', UUID('da07ec00-1d6f-4bed-a71a-448e5cd38d5c')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap39c985ac-2f, col_values=(('external_ids', {'iface-id': '39c985ac-2f47-482e-8376-5a0d6531bbd4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:64:d0', 'vm-uuid': '2c40f2a3-dbfb-497d-8ec3-df38105cad20'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: INFO os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=39c985ac-2f47-482e-8376-5a0d6531bbd4,network=Network(ba224a99-36e3-41e7-9680-2706ddbc2be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c985ac-2f')
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:cd,bridge_name='br-int',has_traffic_filtering=True,id=3158e32f-b3dc-4bbf-878e-dcb004f642a3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3158e32f-b3') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:cd,bridge_name='br-int',has_traffic_filtering=True,id=3158e32f-b3dc-4bbf-878e-dcb004f642a3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3158e32f-b3') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '462965ec-df5b-52ed-8569-919a1d75f05a', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3158e32f-b3, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3158e32f-b3, col_values=(('qos', UUID('961d7f03-0bde-4b91-b8d7-4ba3c41c6e0b')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3158e32f-b3, col_values=(('external_ids', {'iface-id': '3158e32f-b3dc-4bbf-878e-dcb004f642a3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c5:a5:cd', 'vm-uuid': '2c40f2a3-dbfb-497d-8ec3-df38105cad20'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: INFO os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:cd,bridge_name='br-int',has_traffic_filtering=True,id=3158e32f-b3dc-4bbf-878e-dcb004f642a3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3158e32f-b3')
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=ba625408-a772-4626-82a3-b411c917d6cd,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba625408-a7') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=ba625408-a772-4626-82a3-b411c917d6cd,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba625408-a7') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '39338382-897a-5e70-b296-614489249fe6', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapba625408-a7, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapba625408-a7, col_values=(('qos', UUID('f44c8506-56d7-449e-a2ad-7229e4d39a15')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapba625408-a7, col_values=(('external_ids', {'iface-id': 'ba625408-a772-4626-82a3-b411c917d6cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:cd:06', 'vm-uuid': '2c40f2a3-dbfb-497d-8ec3-df38105cad20'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: INFO os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=ba625408-a772-4626-82a3-b411c917d6cd,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba625408-a7')
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b83d6e13-aa0f-4815-8b3e-91e003b2b136,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d6e13-aa') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b83d6e13-aa0f-4815-8b3e-91e003b2b136,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d6e13-aa') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b427570-8130-593e-a9ea-31374934c16b', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb83d6e13-aa, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb83d6e13-aa, col_values=(('qos', UUID('0e229339-a0b3-4e24-bd19-07bec2d3e5ff')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb83d6e13-aa, col_values=(('external_ids', {'iface-id': 'b83d6e13-aa0f-4815-8b3e-91e003b2b136', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:14:b8', 'vm-uuid': '2c40f2a3-dbfb-497d-8ec3-df38105cad20'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: INFO os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b83d6e13-aa0f-4815-8b3e-91e003b2b136,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d6e13-aa')
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=03e161ba-5708-40fa-96d1-895fbaf95ca3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e161ba-57') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=03e161ba-5708-40fa-96d1-895fbaf95ca3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e161ba-57') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4cf9afb-23c1-5507-a273-da569d51cea2', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap03e161ba-57, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap03e161ba-57, col_values=(('qos', UUID('55f7f3d9-5154-4550-94ff-5685c1c2e2fc')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap03e161ba-57, col_values=(('external_ids', {'iface-id': '03e161ba-5708-40fa-96d1-895fbaf95ca3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:45:9e', 'vm-uuid': '2c40f2a3-dbfb-497d-8ec3-df38105cad20'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: INFO os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=03e161ba-5708-40fa-96d1-895fbaf95ca3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e161ba-57')
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b4412faa-9961-4fa7-9993-76a00afbe6b6,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4412faa-99') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b4412faa-9961-4fa7-9993-76a00afbe6b6,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4412faa-99') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '933009c1-9fa8-5b50-b9e1-2cc43411fb77', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb4412faa-99, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb4412faa-99, col_values=(('qos', UUID('a6327749-7592-4851-bc07-4a414ab4232c')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb4412faa-99, col_values=(('external_ids', {'iface-id': 'b4412faa-9961-4fa7-9993-76a00afbe6b6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bb:b0:5a', 'vm-uuid': '2c40f2a3-dbfb-497d-8ec3-df38105cad20'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: INFO os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b4412faa-9961-4fa7-9993-76a00afbe6b6,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4412faa-99')
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:17:58Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1c:e5,bridge_name='br-int',has_traffic_filtering=True,id=a0215f7d-3a99-4c69-af70-d886b84dcc36,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0215f7d-3a') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1c:e5,bridge_name='br-int',has_traffic_filtering=True,id=a0215f7d-3a99-4c69-af70-d886b84dcc36,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0215f7d-3a') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '68100632-3bd1-5d3d-bac7-8aa48ab8f524', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:28 user nova-compute[75102]: INFO nova.compute.manager [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Terminating instance
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa0215f7d-3a, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa0215f7d-3a, col_values=(('qos', UUID('1f4fe86b-8558-4ae7-87d2-2f254e6faee8')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa0215f7d-3a, col_values=(('external_ids', {'iface-id': 'a0215f7d-3a99-4c69-af70-d886b84dcc36', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:1c:e5', 'vm-uuid': '2c40f2a3-dbfb-497d-8ec3-df38105cad20'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:29 user nova-compute[75102]: INFO os_vif [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1c:e5,bridge_name='br-int',has_traffic_filtering=True,id=a0215f7d-3a99-4c69-af70-d886b84dcc36,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0215f7d-3a')
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] No BDM found with device name hda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] No VIF found with MAC fa:16:3e:44:64:d0, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] No VIF found with MAC fa:16:3e:d9:45:9e, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:20:29 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Using config drive
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-f2cea7af-8425-4b1c-8e6a-fc4ebe1dca20 req-cbf83b18-1e3a-4adf-a5d3-d1f6f5ce88a9 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-unplugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f2cea7af-8425-4b1c-8e6a-fc4ebe1dca20 req-cbf83b18-1e3a-4adf-a5d3-d1f6f5ce88a9 service nova] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f2cea7af-8425-4b1c-8e6a-fc4ebe1dca20 req-cbf83b18-1e3a-4adf-a5d3-d1f6f5ce88a9 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f2cea7af-8425-4b1c-8e6a-fc4ebe1dca20 req-cbf83b18-1e3a-4adf-a5d3-d1f6f5ce88a9 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-f2cea7af-8425-4b1c-8e6a-fc4ebe1dca20 req-cbf83b18-1e3a-4adf-a5d3-d1f6f5ce88a9 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] No waiting events found dispatching network-vif-unplugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-f2cea7af-8425-4b1c-8e6a-fc4ebe1dca20 req-cbf83b18-1e3a-4adf-a5d3-d1f6f5ce88a9 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-unplugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:20:29 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Creating config drive at /opt/stack/data/nova/instances/2c40f2a3-dbfb-497d-8ec3-df38105cad20/disk.config
Nov 10 16:20:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/2c40f2a3-dbfb-497d-8ec3-df38105cad20/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpppyo6k7j {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/2c40f2a3-dbfb-497d-8ec3-df38105cad20/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpppyo6k7j" returned: 0 in 0.076s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Instance destroyed successfully.
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG nova.objects.instance [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lazy-loading 'resources' on Instance uuid cc9e365b-8b0a-40db-bbc4-026f609cdd7a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-1578654316',display_name='tempest-AttachSCSIVolumeTestJSON-server-1578654316',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-1578654316',id=4,image_ref='93d1197e-a00f-4bbb-abd4-a779d86970de',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPtcdZnCaIq1Iz2tJdyNq67KlNym1pavQH0r3h+vs4/buHNn/+KxjJ79zEbRuWHiRHAooVo1wOFR5WYiL5EvU54/YNqtrBKoUimby6mp6rh5YHsTZudCfDimLklXfKmACg==',key_name='tempest-keypair-996940272',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0637a4e0453f4b8195d49cae42dc7de1',ramdisk_id='',reservation_id='r-ulq6nf4h',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='93d1197e-a00f-4bbb-abd4-a779d86970de',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1281465552',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1281465552-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='967fff952d084989b19cc487c4773e22',uuid=cc9e365b-8b0a-40db-bbc4-026f609cdd7a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Converting VIF {"id": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "address": "fa:16:3e:e6:1e:7d", "network": {"id": "affc9dec-d2f2-47b4-afe2-3c5a370f3a9c", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-2024721448-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.111", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0637a4e0453f4b8195d49cae42dc7de1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd00f79b8-75", "ovs_interfaceid": "d00f79b8-7518-4a77-a447-16d1ebcf0be1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e6:1e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d00f79b8-7518-4a77-a447-16d1ebcf0be1,network=Network(affc9dec-d2f2-47b4-afe2-3c5a370f3a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd00f79b8-75') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG os_vif [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:1e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d00f79b8-7518-4a77-a447-16d1ebcf0be1,network=Network(affc9dec-d2f2-47b4-afe2-3c5a370f3a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd00f79b8-75') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd00f79b8-75, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4421ac3f-e9cc-4e75-a8de-4856ab483740) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: INFO os_vif [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e6:1e:7d,bridge_name='br-int',has_traffic_filtering=True,id=d00f79b8-7518-4a77-a447-16d1ebcf0be1,network=Network(affc9dec-d2f2-47b4-afe2-3c5a370f3a9c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd00f79b8-75')
Nov 10 16:20:30 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Deleting instance files /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a_del
Nov 10 16:20:30 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Deletion of /opt/stack/data/nova/instances/cc9e365b-8b0a-40db-bbc4-026f609cdd7a_del complete
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: INFO nova.compute.manager [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 10 16:20:30 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:31 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 83ad82f3-4e34-46fd-94a6-71adb8884eda is timed out.
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] No waiting events found dispatching network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:31 user nova-compute[75102]: WARNING nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received unexpected event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 for instance with vm_state active and task_state deleting.
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] No waiting events found dispatching network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:31 user nova-compute[75102]: WARNING nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received unexpected event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 for instance with vm_state active and task_state deleting.
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] No waiting events found dispatching network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:31 user nova-compute[75102]: WARNING nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received unexpected event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 for instance with vm_state active and task_state deleting.
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-unplugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] No waiting events found dispatching network-vif-unplugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-unplugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Acquiring lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] No waiting events found dispatching network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:31 user nova-compute[75102]: WARNING nova.compute.manager [req-1c228040-ae63-46e0-aac9-e91dd53b7fab req-f0e85f0f-513b-4663-a6e4-56568c524934 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received unexpected event network-vif-plugged-d00f79b8-7518-4a77-a447-16d1ebcf0be1 for instance with vm_state active and task_state deleting.
Nov 10 16:20:31 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Successfully detached device vdb from instance 83ad82f3-4e34-46fd-94a6-71adb8884eda from the live domain config.
Nov 10 16:20:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MvaltFpQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-39e5e6ef-5bcd-485f-b7bb-7da281e8ee72 req-696345e2-39e7-463d-9203-29f426ffa1a4 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Received event network-vif-deleted-d00f79b8-7518-4a77-a447-16d1ebcf0be1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:31 user nova-compute[75102]: INFO nova.compute.manager [req-39e5e6ef-5bcd-485f-b7bb-7da281e8ee72 req-696345e2-39e7-463d-9203-29f426ffa1a4 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Neutron deleted interface d00f79b8-7518-4a77-a447-16d1ebcf0be1; detaching it from the instance and deleting it from the info cache
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.network.neutron [req-39e5e6ef-5bcd-485f-b7bb-7da281e8ee72 req-696345e2-39e7-463d-9203-29f426ffa1a4 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31816a9-5e96-4f28-a8d4-e771599d843d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:20:31 user nova-compute[75102]: No targets found.
Nov 10 16:20:31 user nova-compute[75102]: iSNS:
Nov 10 16:20:31 user nova-compute[75102]: No targets found.
Nov 10 16:20:31 user nova-compute[75102]: STATIC:
Nov 10 16:20:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da
Nov 10 16:20:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4
Nov 10 16:20:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:20:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:20:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0
Nov 10 16:20:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e
Nov 10 16:20:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22
Nov 10 16:20:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:31 user nova-compute[75102]: FIRMWARE:
Nov 10 16:20:31 user nova-compute[75102]: No targets found.
Nov 10 16:20:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:20:31 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:20:31 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:31 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Took 1.16 seconds to deallocate network for instance.
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[911b40b7-a3e8-4e20-8761-9ebfe8ba8866]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-39e5e6ef-5bcd-485f-b7bb-7da281e8ee72 req-696345e2-39e7-463d-9203-29f426ffa1a4 service nova] [instance: cc9e365b-8b0a-40db-bbc4-026f609cdd7a] Detach interface failed, port_id=d00f79b8-7518-4a77-a447-16d1ebcf0be1, reason: Instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.051s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ed1733-7f4f-48dd-ad8c-52bc463c524d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:31 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74783400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac5e09fc-6b1a-45ab-b74e-f5049ee8d5c5]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23f7636-e9ed-4dd7-9682-1b560993de92]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc812324-6d75-4fef-a459-dcecb7bbb07d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:31 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 is timed out.
Nov 10 16:20:31 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Successfully detached device vdb from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 from the live domain config.
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-a9d3164b-9fff-4201-9b98-1f3c0f433529 req-453c2bf9-b90b-4525-9170-99476a9f279e service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a9d3164b-9fff-4201-9b98-1f3c0f433529 req-453c2bf9-b90b-4525-9170-99476a9f279e service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a9d3164b-9fff-4201-9b98-1f3c0f433529 req-453c2bf9-b90b-4525-9170-99476a9f279e service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a9d3164b-9fff-4201-9b98-1f3c0f433529 req-453c2bf9-b90b-4525-9170-99476a9f279e service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-a9d3164b-9fff-4201-9b98-1f3c0f433529 req-453c2bf9-b90b-4525-9170-99476a9f279e service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:31 user nova-compute[75102]: WARNING nova.compute.manager [req-a9d3164b-9fff-4201-9b98-1f3c0f433529 req-453c2bf9-b90b-4525-9170-99476a9f279e service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 for instance with vm_state building and task_state spawning.
Nov 10 16:20:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oxWOZbRa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:20:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1df93429-4ce5-4b83-9b1f-ec461e67487c]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:20:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[98aaa1e5-49d4-429b-adcd-b4a476dc5b6d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3346413e-9835-46a1-9e27-b8bd921a52ea]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0, portal: 172.16.0.220,3260]
Nov 10 16:20:32 user nova-compute[75102]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0, portal: 172.16.0.220,3260] successful.
Nov 10 16:20:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:05532186-37ef-4e14-8ac6-e33aa6fd25e0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.045s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b7c4e7-0cb5-428d-9f26-abf351152f92]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.492s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] <== disconnect_volume: return (494ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.199s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5817123-0de7-466b-a075-c9561d258eaa]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:20:32 user nova-compute[75102]: No targets found.
Nov 10 16:20:32 user nova-compute[75102]: iSNS:
Nov 10 16:20:32 user nova-compute[75102]: No targets found.
Nov 10 16:20:32 user nova-compute[75102]: STATIC:
Nov 10 16:20:32 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da
Nov 10 16:20:32 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:32 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:32 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4
Nov 10 16:20:32 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:32 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:32 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:20:32 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:32 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:32 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:20:32 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:32 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:32 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e
Nov 10 16:20:32 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:32 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:32 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22
Nov 10 16:20:32 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:20:32 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:20:32 user nova-compute[75102]: FIRMWARE:
Nov 10 16:20:32 user nova-compute[75102]: No targets found.
Nov 10 16:20:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:20:32 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:20:32 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fd18aa1-f6fc-4da9-a27d-8dce4d9a1bf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d03179-db6e-45b9-ad7a-8046caa133cb]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:20:32 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:20:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7449d5a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4'): ({'sde'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Removing single pathed devices sde {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8d1399-7346-4b26-85c8-bc3b51830247]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[324b40e8-ed76-41f2-9242-2ac6cb7cc278]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Flushing IO for device /dev/sde {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28c2843-5918-45b4-bcf4-db2b2f3bc956]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.076s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25365ee-cc0a-4366-8a48-1634b1ce0b0a]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.714s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1f175f-a265-4777-acc0-2e4b48cab3b6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Deleted allocations for instance cc9e365b-8b0a-40db-bbc4-026f609cdd7a
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.088s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[acafb9f7-b66b-42cb-b074-266e3e12e3fc]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4, portal: 172.16.0.220,3260]
Nov 10 16:20:32 user nova-compute[75102]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4, portal: 172.16.0.220,3260] successful.
Nov 10 16:20:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:df7e03fe-e51a-4167-a5c0-d4e05cf620d4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc0218d-fe72-481a-9512-5e5dae18d93e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.515s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] <== disconnect_volume: return (714ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-46033c3c-cbe3-40ac-a4cb-361cb25ddc0b tempest-AttachSCSIVolumeTestJSON-1281465552 tempest-AttachSCSIVolumeTestJSON-1281465552-project-member] Lock "cc9e365b-8b0a-40db-bbc4-026f609cdd7a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.933s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:33 user nova-compute[75102]: WARNING nova.compute.manager [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 for instance with vm_state building and task_state spawning.
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.005s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:33 user nova-compute[75102]: WARNING nova.compute.manager [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 for instance with vm_state building and task_state spawning.
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:33 user nova-compute[75102]: WARNING nova.compute.manager [req-8f256e1a-dce1-4329-a1e4-3c111752d29d req-a54c3a83-038a-4a56-bdb5-3295af73e708 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 for instance with vm_state building and task_state spawning.
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:33 user nova-compute[75102]: WARNING nova.compute.manager [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-ba625408-a772-4626-82a3-b411c917d6cd for instance with vm_state building and task_state spawning.
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:33 user nova-compute[75102]: WARNING nova.compute.manager [req-0f22ba3b-4604-4d1a-b846-caaf69d1a810 req-9638c043-865a-4036-a22e-df02d042bc2b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-ba625408-a772-4626-82a3-b411c917d6cd for instance with vm_state building and task_state spawning.
Nov 10 16:20:33 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lazy-loading 'flavor' on Instance uuid 83ad82f3-4e34-46fd-94a6-71adb8884eda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3c320105-0912-4b12-9036-533f0ac0aefb tempest-VolumesAssistedSnapshotsTest-860935800 tempest-VolumesAssistedSnapshotsTest-860935800-project-admin] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.263s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-e8d4c7b7-e391-4f23-80b5-165647c15d71 req-30152d2f-35b3-4e99-89de-df164cc41547 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8d4c7b7-e391-4f23-80b5-165647c15d71 req-30152d2f-35b3-4e99-89de-df164cc41547 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8d4c7b7-e391-4f23-80b5-165647c15d71 req-30152d2f-35b3-4e99-89de-df164cc41547 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8d4c7b7-e391-4f23-80b5-165647c15d71 req-30152d2f-35b3-4e99-89de-df164cc41547 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-e8d4c7b7-e391-4f23-80b5-165647c15d71 req-30152d2f-35b3-4e99-89de-df164cc41547 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:34 user nova-compute[75102]: WARNING nova.compute.manager [req-e8d4c7b7-e391-4f23-80b5-165647c15d71 req-30152d2f-35b3-4e99-89de-df164cc41547 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 for instance with vm_state building and task_state spawning.
Nov 10 16:20:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:35 user nova-compute[75102]: WARNING nova.compute.manager [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 for instance with vm_state building and task_state spawning.
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:35 user nova-compute[75102]: WARNING nova.compute.manager [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 for instance with vm_state building and task_state spawning.
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:35 user nova-compute[75102]: WARNING nova.compute.manager [req-6005bf67-1d9d-4d1f-85fd-e5e40525e073 req-79df73dc-a766-4998-82c1-ccb96a1da1ec service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 for instance with vm_state building and task_state spawning.
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:35 user nova-compute[75102]: WARNING nova.compute.manager [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 for instance with vm_state building and task_state spawning.
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:35 user nova-compute[75102]: WARNING nova.compute.manager [req-7b8c44d0-b8b0-4dbf-b663-f57b6ac98106 req-52632487-a693-48e3-bb6a-b27aa0c7b7c8 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 for instance with vm_state building and task_state spawning.
Nov 10 16:20:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:35 user nova-compute[75102]: DEBUG nova.objects.instance [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lazy-loading 'flavor' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a3b8c11-7f38-455d-b1e2-405dc05eb575 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 25.083s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:36 user nova-compute[75102]: WARNING nova.compute.manager [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 for instance with vm_state building and task_state spawning.
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:36 user nova-compute[75102]: WARNING nova.compute.manager [req-f420aa06-c133-4fc2-826b-4e501717fce0 req-b1d88a06-a032-422a-9187-cc9155e4798f service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 for instance with vm_state building and task_state spawning.
Nov 10 16:20:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "interface-73ffbf3a-c989-4165-b886-9b5b6ca94e90-04e5a27d-f5c1-404a-b694-36e87ac2be8b" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "interface-73ffbf3a-c989-4165-b886-9b5b6ca94e90-04e5a27d-f5c1-404a-b694-36e87ac2be8b" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.objects.instance [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lazy-loading 'flavor' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13933405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13933405',id=6,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+qq64H5Vbjx8Inx+6yEga0vLwbJNL0epCbJdKi3Gom0oTPj8h30FZ5w3N1JQxqZvcLGfPUVHHvK4qcUmB4N/TDmyU59bYy0FuC/NEh/MF4Ce92Mb5OlPfx9teriOA4hQ==',key_name='tempest-keypair-1570286825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941ab220f5014f92940dc69ff115395d',ramdisk_id='',reservation_id='r-0ilj5ijd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-777879608',owner_user_name='tempest-TaggedAttachmentsTest-777879608-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3feb9b9df3e4b80ae23321c15848efa',uuid=73ffbf3a-c989-4165-b886-9b5b6ca94e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converting VIF {"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface> {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface> {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Attempting to detach device tap04e5a27d-f5 from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] detach device xml: <interface type="ethernet">
Nov 10 16:20:36 user nova-compute[75102]:   <mac address="fa:16:3e:98:36:f2"/>
Nov 10 16:20:36 user nova-compute[75102]:   <model type="virtio"/>
Nov 10 16:20:36 user nova-compute[75102]:   <mtu size="1442"/>
Nov 10 16:20:36 user nova-compute[75102]:   <target dev="tap04e5a27d-f5"/>
Nov 10 16:20:36 user nova-compute[75102]: </interface>
Nov 10 16:20:36 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface> {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 10 16:20:36 user nova-compute[75102]:   <name>instance-00000006</name>
Nov 10 16:20:36 user nova-compute[75102]:   <uuid>73ffbf3a-c989-4165-b886-9b5b6ca94e90</uuid>
Nov 10 16:20:36 user nova-compute[75102]:   <metadata>
Nov 10 16:20:36 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:20:36 user nova-compute[75102]:   <nova:package version="0.0.0"/>
Nov 10 16:20:36 user nova-compute[75102]:   <nova:name>tempest-device-tagging-server-13933405</nova:name>
Nov 10 16:20:36 user nova-compute[75102]:   <nova:creationTime>2023-11-10 16:18:26</nova:creationTime>
Nov 10 16:20:36 user nova-compute[75102]:   <nova:flavor name="m1.tiny">
Nov 10 16:20:36 user nova-compute[75102]:     <nova:memory>512</nova:memory>
Nov 10 16:20:36 user nova-compute[75102]:     <nova:disk>1</nova:disk>
Nov 10 16:20:36 user nova-compute[75102]:     <nova:swap>0</nova:swap>
Nov 10 16:20:36 user nova-compute[75102]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:20:36 user nova-compute[75102]:     <nova:vcpus>1</nova:vcpus>
Nov 10 16:20:36 user nova-compute[75102]:   </nova:flavor>
Nov 10 16:20:36 user nova-compute[75102]:   <nova:owner>
Nov 10 16:20:36 user nova-compute[75102]:     <nova:user uuid="c3feb9b9df3e4b80ae23321c15848efa">tempest-TaggedAttachmentsTest-777879608-project-member</nova:user>
Nov 10 16:20:36 user nova-compute[75102]:     <nova:project uuid="941ab220f5014f92940dc69ff115395d">tempest-TaggedAttachmentsTest-777879608</nova:project>
Nov 10 16:20:36 user nova-compute[75102]:   </nova:owner>
Nov 10 16:20:36 user nova-compute[75102]:   <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:20:36 user nova-compute[75102]:   <nova:ports>
Nov 10 16:20:36 user nova-compute[75102]:     <nova:port uuid="85ff080c-d374-4dde-aec4-b0dbd4b835b0">
Nov 10 16:20:36 user nova-compute[75102]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:20:36 user nova-compute[75102]:     </nova:port>
Nov 10 16:20:36 user nova-compute[75102]:     <nova:port uuid="04e5a27d-f5c1-404a-b694-36e87ac2be8b">
Nov 10 16:20:36 user nova-compute[75102]:       <nova:ip type="fixed" address="10.10.10.69" ipVersion="4"/>
Nov 10 16:20:36 user nova-compute[75102]:     </nova:port>
Nov 10 16:20:36 user nova-compute[75102]:   </nova:ports>
Nov 10 16:20:36 user nova-compute[75102]: </nova:instance>
Nov 10 16:20:36 user nova-compute[75102]:   </metadata>
Nov 10 16:20:36 user nova-compute[75102]:   <memory unit='KiB'>524288</memory>
Nov 10 16:20:36 user nova-compute[75102]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 16:20:36 user nova-compute[75102]:   <vcpu placement='static'>1</vcpu>
Nov 10 16:20:36 user nova-compute[75102]:   <resource>
Nov 10 16:20:36 user nova-compute[75102]:     <partition>/machine</partition>
Nov 10 16:20:36 user nova-compute[75102]:   </resource>
Nov 10 16:20:36 user nova-compute[75102]:   <sysinfo type='smbios'>
Nov 10 16:20:36 user nova-compute[75102]:     <system>
Nov 10 16:20:36 user nova-compute[75102]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 16:20:36 user nova-compute[75102]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 16:20:36 user nova-compute[75102]:       <entry name='version'>0.0.0</entry>
Nov 10 16:20:36 user nova-compute[75102]:       <entry name='serial'>73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:20:36 user nova-compute[75102]:       <entry name='uuid'>73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:20:36 user nova-compute[75102]:       <entry name='family'>Virtual Machine</entry>
Nov 10 16:20:36 user nova-compute[75102]:     </system>
Nov 10 16:20:36 user nova-compute[75102]:   </sysinfo>
Nov 10 16:20:36 user nova-compute[75102]:   <os>
Nov 10 16:20:36 user nova-compute[75102]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 16:20:36 user nova-compute[75102]:     <boot dev='hd'/>
Nov 10 16:20:36 user nova-compute[75102]:     <smbios mode='sysinfo'/>
Nov 10 16:20:36 user nova-compute[75102]:   </os>
Nov 10 16:20:36 user nova-compute[75102]:   <features>
Nov 10 16:20:36 user nova-compute[75102]:     <acpi/>
Nov 10 16:20:36 user nova-compute[75102]:     <apic/>
Nov 10 16:20:36 user nova-compute[75102]:     <vmcoreinfo state='on'/>
Nov 10 16:20:36 user nova-compute[75102]:   </features>
Nov 10 16:20:36 user nova-compute[75102]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 16:20:36 user nova-compute[75102]:     <model fallback='forbid'>Nehalem</model>
Nov 10 16:20:36 user nova-compute[75102]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 16:20:36 user nova-compute[75102]:     <feature policy='require' name='vme'/>
Nov 10 16:20:36 user nova-compute[75102]:     <feature policy='require' name='x2apic'/>
Nov 10 16:20:36 user nova-compute[75102]:     <feature policy='require' name='hypervisor'/>
Nov 10 16:20:36 user nova-compute[75102]:   </cpu>
Nov 10 16:20:36 user nova-compute[75102]:   <clock offset='utc'>
Nov 10 16:20:36 user nova-compute[75102]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 16:20:36 user nova-compute[75102]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 16:20:36 user nova-compute[75102]:     <timer name='hpet' present='no'/>
Nov 10 16:20:36 user nova-compute[75102]:   </clock>
Nov 10 16:20:36 user nova-compute[75102]:   <on_poweroff>destroy</on_poweroff>
Nov 10 16:20:36 user nova-compute[75102]:   <on_reboot>restart</on_reboot>
Nov 10 16:20:36 user nova-compute[75102]:   <on_crash>destroy</on_crash>
Nov 10 16:20:36 user nova-compute[75102]:   <devices>
Nov 10 16:20:36 user nova-compute[75102]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 16:20:36 user nova-compute[75102]:     <disk type='file' device='disk'>
Nov 10 16:20:36 user nova-compute[75102]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 16:20:36 user nova-compute[75102]:       <source file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk' index='2'/>
Nov 10 16:20:36 user nova-compute[75102]:       <backingStore type='file' index='3'>
Nov 10 16:20:36 user nova-compute[75102]:         <format type='raw'/>
Nov 10 16:20:36 user nova-compute[75102]:         <source file='/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb'/>
Nov 10 16:20:36 user nova-compute[75102]:         <backingStore/>
Nov 10 16:20:36 user nova-compute[75102]:       </backingStore>
Nov 10 16:20:36 user nova-compute[75102]:       <target dev='vda' bus='virtio'/>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='virtio-disk0'/>
Nov 10 16:20:36 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </disk>
Nov 10 16:20:36 user nova-compute[75102]:     <disk type='file' device='cdrom'>
Nov 10 16:20:36 user nova-compute[75102]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 16:20:36 user nova-compute[75102]:       <source file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.config' index='1'/>
Nov 10 16:20:36 user nova-compute[75102]:       <backingStore/>
Nov 10 16:20:36 user nova-compute[75102]:       <target dev='hda' bus='ide'/>
Nov 10 16:20:36 user nova-compute[75102]:       <readonly/>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='ide0-0-0'/>
Nov 10 16:20:36 user nova-compute[75102]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </disk>
Nov 10 16:20:36 user nova-compute[75102]:     <controller type='usb' index='0' model='none'>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='usb'/>
Nov 10 16:20:36 user nova-compute[75102]:     </controller>
Nov 10 16:20:36 user nova-compute[75102]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='pci.0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </controller>
Nov 10 16:20:36 user nova-compute[75102]:     <controller type='ide' index='0'>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='ide'/>
Nov 10 16:20:36 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 16:20:36 user nova-compute[75102]:     </controller>
Nov 10 16:20:36 user nova-compute[75102]:     <interface type='ethernet'>
Nov 10 16:20:36 user nova-compute[75102]:       <mac address='fa:16:3e:e7:33:d1'/>
Nov 10 16:20:36 user nova-compute[75102]:       <target dev='tap85ff080c-d3'/>
Nov 10 16:20:36 user nova-compute[75102]:       <model type='virtio'/>
Nov 10 16:20:36 user nova-compute[75102]:       <mtu size='1442'/>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='net0'/>
Nov 10 16:20:36 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </interface>
Nov 10 16:20:36 user nova-compute[75102]:     <interface type='ethernet'>
Nov 10 16:20:36 user nova-compute[75102]:       <mac address='fa:16:3e:98:36:f2'/>
Nov 10 16:20:36 user nova-compute[75102]:       <target dev='tap04e5a27d-f5'/>
Nov 10 16:20:36 user nova-compute[75102]:       <model type='virtio'/>
Nov 10 16:20:36 user nova-compute[75102]:       <mtu size='1442'/>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='net1'/>
Nov 10 16:20:36 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </interface>
Nov 10 16:20:36 user nova-compute[75102]:     <serial type='pty'>
Nov 10 16:20:36 user nova-compute[75102]:       <source path='/dev/pts/5'/>
Nov 10 16:20:36 user nova-compute[75102]:       <log file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log' append='off'/>
Nov 10 16:20:36 user nova-compute[75102]:       <target type='isa-serial' port='0'>
Nov 10 16:20:36 user nova-compute[75102]:         <model name='isa-serial'/>
Nov 10 16:20:36 user nova-compute[75102]:       </target>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='serial0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </serial>
Nov 10 16:20:36 user nova-compute[75102]:     <console type='pty' tty='/dev/pts/5'>
Nov 10 16:20:36 user nova-compute[75102]:       <source path='/dev/pts/5'/>
Nov 10 16:20:36 user nova-compute[75102]:       <log file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log' append='off'/>
Nov 10 16:20:36 user nova-compute[75102]:       <target type='serial' port='0'/>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='serial0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </console>
Nov 10 16:20:36 user nova-compute[75102]:     <input type='mouse' bus='ps2'>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='input0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </input>
Nov 10 16:20:36 user nova-compute[75102]:     <input type='keyboard' bus='ps2'>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='input1'/>
Nov 10 16:20:36 user nova-compute[75102]:     </input>
Nov 10 16:20:36 user nova-compute[75102]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 10 16:20:36 user nova-compute[75102]:       <listen type='address' address='0.0.0.0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </graphics>
Nov 10 16:20:36 user nova-compute[75102]:     <audio id='1' type='none'/>
Nov 10 16:20:36 user nova-compute[75102]:     <video>
Nov 10 16:20:36 user nova-compute[75102]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='video0'/>
Nov 10 16:20:36 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </video>
Nov 10 16:20:36 user nova-compute[75102]:     <memballoon model='virtio'>
Nov 10 16:20:36 user nova-compute[75102]:       <stats period='10'/>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='balloon0'/>
Nov 10 16:20:36 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </memballoon>
Nov 10 16:20:36 user nova-compute[75102]:     <rng model='virtio'>
Nov 10 16:20:36 user nova-compute[75102]:       <backend model='random'>/dev/urandom</backend>
Nov 10 16:20:36 user nova-compute[75102]:       <alias name='rng0'/>
Nov 10 16:20:36 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 16:20:36 user nova-compute[75102]:     </rng>
Nov 10 16:20:36 user nova-compute[75102]:   </devices>
Nov 10 16:20:36 user nova-compute[75102]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 16:20:36 user nova-compute[75102]:     <label>libvirt-73ffbf3a-c989-4165-b886-9b5b6ca94e90</label>
Nov 10 16:20:36 user nova-compute[75102]:     <imagelabel>libvirt-73ffbf3a-c989-4165-b886-9b5b6ca94e90</imagelabel>
Nov 10 16:20:36 user nova-compute[75102]:   </seclabel>
Nov 10 16:20:36 user nova-compute[75102]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 16:20:36 user nova-compute[75102]:     <label>+64055:+108</label>
Nov 10 16:20:36 user nova-compute[75102]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 16:20:36 user nova-compute[75102]:   </seclabel>
Nov 10 16:20:36 user nova-compute[75102]: </domain>
Nov 10 16:20:36 user nova-compute[75102]:  {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 16:20:36 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Successfully detached device tap04e5a27d-f5 from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 from the persistent domain config.
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] (1/8): Attempting to detach device tap04e5a27d-f5 with device alias net1 from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] detach device xml: <interface type="ethernet">
Nov 10 16:20:36 user nova-compute[75102]:   <mac address="fa:16:3e:98:36:f2"/>
Nov 10 16:20:36 user nova-compute[75102]:   <model type="virtio"/>
Nov 10 16:20:36 user nova-compute[75102]:   <mtu size="1442"/>
Nov 10 16:20:36 user nova-compute[75102]:   <target dev="tap04e5a27d-f5"/>
Nov 10 16:20:36 user nova-compute[75102]: </interface>
Nov 10 16:20:36 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:20:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:20:37 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance spawned successfully.
Nov 10 16:20:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:37 user nova-compute[75102]: INFO nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Took 13.66 seconds to spawn the instance on the hypervisor.
Nov 10 16:20:37 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Start waiting for the detach event from libvirt for device tap04e5a27d-f5 with device alias net1 for instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:37 user nova-compute[75102]: INFO nova.compute.manager [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Took 160.50 seconds to build instance.
Nov 10 16:20:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3950f24-8a20-4315-a2d5-1f5da1e4c66b tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 160.613s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-unplugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] No waiting events found dispatching network-vif-unplugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:38 user nova-compute[75102]: WARNING nova.compute.manager [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received unexpected event network-vif-unplugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b for instance with vm_state active and task_state None.
Nov 10 16:20:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-plugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] No waiting events found dispatching network-vif-plugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:20:38 user nova-compute[75102]: WARNING nova.compute.manager [req-190b189f-4e13-4cad-ac0b-985b2a6194d8 req-a1e52434-e9c7-48c6-8466-a57beff825ec service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received unexpected event network-vif-plugged-04e5a27d-f5c1-404a-b694-36e87ac2be8b for instance with vm_state active and task_state None.
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.volume.cinder [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] Update attachment failed for attachment 7690e821-d234-402d-b763-3e18ae7324d0. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b6754a93-31ee-41c5-b0c9-7e439b50cb45) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b6754a93-31ee-41c5-b0c9-7e439b50cb45)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Failed to connect to volume 6324edb8-26fd-441c-8a95-f42af6529431 with volume at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b6754a93-31ee-41c5-b0c9-7e439b50cb45)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Traceback (most recent call last):
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     new_cinfo = self.volume_api.attachment_update(
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     res = method(self, ctx, *args, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     with excutils.save_and_reraise_exception():
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     self.force_reraise()
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     raise self.value
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     return method.func(obj, *args, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     return self.request(url, method, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3]     raise exceptions.from_response(resp, body)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b6754a93-31ee-41c5-b0c9-7e439b50cb45)
Nov 10 16:20:38 user nova-compute[75102]: ERROR nova.compute.manager [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] 
Nov 10 16:20:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 25.252s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server [None req-e8f4cb0b-e605-4a66-a978-9e934bc165ef tempest-TestVolumeSwap-541315838 tempest-TestVolumeSwap-541315838-project-admin] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b6754a93-31ee-41c5-b0c9-7e439b50cb45)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7903, in swap_volume
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     _do_locked_swap_volume(context, old_volume_id, new_volume_id, instance,
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7901, in _do_locked_swap_volume
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._do_swap_volume(context, old_volume_id, new_volume_id,
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7945, in _do_swap_volume
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     comp_ret, new_cinfo = self._swap_volume(context,
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7794, in _swap_volume
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7770, in _swap_volume
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     old_cinfo, new_cinfo = self._init_volume_connection(
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7743, in _init_volume_connection
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     new_cinfo = self.volume_api.attachment_update(
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-b6754a93-31ee-41c5-b0c9-7e439b50cb45)
Nov 10 16:20:38 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:20:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:20:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:45 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:20:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:20:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:20:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Updating instance_info_cache with network_info: [{"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-83ad82f3-4e34-46fd-94a6-71adb8884eda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:49 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:20:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:20:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:20:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:20:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:20:53 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:20:53 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7941MB free_disk=25.552188873291016GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 83ad82f3-4e34-46fd-94a6-71adb8884eda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ab373f84-9ba6-4336-bca7-602464b61fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6458fc11-6612-4108-addd-ce61d935431e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 2c40f2a3-dbfb-497d-8ec3-df38105cad20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a8562537-34e2-45eb-835c-a4dd59e3af7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.531s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:55 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:20:55 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:20:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:20:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:57 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Waiting for libvirt event about the detach of device tap04e5a27d-f5 with device alias net1 from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 is timed out.
Nov 10 16:20:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface> {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 10 16:20:57 user nova-compute[75102]:   <name>instance-00000006</name>
Nov 10 16:20:57 user nova-compute[75102]:   <uuid>73ffbf3a-c989-4165-b886-9b5b6ca94e90</uuid>
Nov 10 16:20:57 user nova-compute[75102]:   <metadata>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:20:57 user nova-compute[75102]:   <nova:package version="0.0.0"/>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:name>tempest-device-tagging-server-13933405</nova:name>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:creationTime>2023-11-10 16:18:26</nova:creationTime>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:flavor name="m1.tiny">
Nov 10 16:20:57 user nova-compute[75102]:     <nova:memory>512</nova:memory>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:disk>1</nova:disk>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:swap>0</nova:swap>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:vcpus>1</nova:vcpus>
Nov 10 16:20:57 user nova-compute[75102]:   </nova:flavor>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:owner>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:user uuid="c3feb9b9df3e4b80ae23321c15848efa">tempest-TaggedAttachmentsTest-777879608-project-member</nova:user>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:project uuid="941ab220f5014f92940dc69ff115395d">tempest-TaggedAttachmentsTest-777879608</nova:project>
Nov 10 16:20:57 user nova-compute[75102]:   </nova:owner>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:ports>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:port uuid="85ff080c-d374-4dde-aec4-b0dbd4b835b0">
Nov 10 16:20:57 user nova-compute[75102]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:20:57 user nova-compute[75102]:     </nova:port>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:port uuid="04e5a27d-f5c1-404a-b694-36e87ac2be8b">
Nov 10 16:20:57 user nova-compute[75102]:       <nova:ip type="fixed" address="10.10.10.69" ipVersion="4"/>
Nov 10 16:20:57 user nova-compute[75102]:     </nova:port>
Nov 10 16:20:57 user nova-compute[75102]:   </nova:ports>
Nov 10 16:20:57 user nova-compute[75102]: </nova:instance>
Nov 10 16:20:57 user nova-compute[75102]:   </metadata>
Nov 10 16:20:57 user nova-compute[75102]:   <memory unit='KiB'>524288</memory>
Nov 10 16:20:57 user nova-compute[75102]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 16:20:57 user nova-compute[75102]:   <vcpu placement='static'>1</vcpu>
Nov 10 16:20:57 user nova-compute[75102]:   <resource>
Nov 10 16:20:57 user nova-compute[75102]:     <partition>/machine</partition>
Nov 10 16:20:57 user nova-compute[75102]:   </resource>
Nov 10 16:20:57 user nova-compute[75102]:   <sysinfo type='smbios'>
Nov 10 16:20:57 user nova-compute[75102]:     <system>
Nov 10 16:20:57 user nova-compute[75102]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 16:20:57 user nova-compute[75102]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 16:20:57 user nova-compute[75102]:       <entry name='version'>0.0.0</entry>
Nov 10 16:20:57 user nova-compute[75102]:       <entry name='serial'>73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:20:57 user nova-compute[75102]:       <entry name='uuid'>73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:20:57 user nova-compute[75102]:       <entry name='family'>Virtual Machine</entry>
Nov 10 16:20:57 user nova-compute[75102]:     </system>
Nov 10 16:20:57 user nova-compute[75102]:   </sysinfo>
Nov 10 16:20:57 user nova-compute[75102]:   <os>
Nov 10 16:20:57 user nova-compute[75102]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 16:20:57 user nova-compute[75102]:     <boot dev='hd'/>
Nov 10 16:20:57 user nova-compute[75102]:     <smbios mode='sysinfo'/>
Nov 10 16:20:57 user nova-compute[75102]:   </os>
Nov 10 16:20:57 user nova-compute[75102]:   <features>
Nov 10 16:20:57 user nova-compute[75102]:     <acpi/>
Nov 10 16:20:57 user nova-compute[75102]:     <apic/>
Nov 10 16:20:57 user nova-compute[75102]:     <vmcoreinfo state='on'/>
Nov 10 16:20:57 user nova-compute[75102]:   </features>
Nov 10 16:20:57 user nova-compute[75102]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 16:20:57 user nova-compute[75102]:     <model fallback='forbid'>Nehalem</model>
Nov 10 16:20:57 user nova-compute[75102]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 16:20:57 user nova-compute[75102]:     <feature policy='require' name='vme'/>
Nov 10 16:20:57 user nova-compute[75102]:     <feature policy='require' name='x2apic'/>
Nov 10 16:20:57 user nova-compute[75102]:     <feature policy='require' name='hypervisor'/>
Nov 10 16:20:57 user nova-compute[75102]:   </cpu>
Nov 10 16:20:57 user nova-compute[75102]:   <clock offset='utc'>
Nov 10 16:20:57 user nova-compute[75102]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 16:20:57 user nova-compute[75102]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 16:20:57 user nova-compute[75102]:     <timer name='hpet' present='no'/>
Nov 10 16:20:57 user nova-compute[75102]:   </clock>
Nov 10 16:20:57 user nova-compute[75102]:   <on_poweroff>destroy</on_poweroff>
Nov 10 16:20:57 user nova-compute[75102]:   <on_reboot>restart</on_reboot>
Nov 10 16:20:57 user nova-compute[75102]:   <on_crash>destroy</on_crash>
Nov 10 16:20:57 user nova-compute[75102]:   <devices>
Nov 10 16:20:57 user nova-compute[75102]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 16:20:57 user nova-compute[75102]:     <disk type='file' device='disk'>
Nov 10 16:20:57 user nova-compute[75102]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 16:20:57 user nova-compute[75102]:       <source file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk' index='2'/>
Nov 10 16:20:57 user nova-compute[75102]:       <backingStore type='file' index='3'>
Nov 10 16:20:57 user nova-compute[75102]:         <format type='raw'/>
Nov 10 16:20:57 user nova-compute[75102]:         <source file='/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb'/>
Nov 10 16:20:57 user nova-compute[75102]:         <backingStore/>
Nov 10 16:20:57 user nova-compute[75102]:       </backingStore>
Nov 10 16:20:57 user nova-compute[75102]:       <target dev='vda' bus='virtio'/>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='virtio-disk0'/>
Nov 10 16:20:57 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </disk>
Nov 10 16:20:57 user nova-compute[75102]:     <disk type='file' device='cdrom'>
Nov 10 16:20:57 user nova-compute[75102]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 16:20:57 user nova-compute[75102]:       <source file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.config' index='1'/>
Nov 10 16:20:57 user nova-compute[75102]:       <backingStore/>
Nov 10 16:20:57 user nova-compute[75102]:       <target dev='hda' bus='ide'/>
Nov 10 16:20:57 user nova-compute[75102]:       <readonly/>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='ide0-0-0'/>
Nov 10 16:20:57 user nova-compute[75102]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </disk>
Nov 10 16:20:57 user nova-compute[75102]:     <controller type='usb' index='0' model='none'>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='usb'/>
Nov 10 16:20:57 user nova-compute[75102]:     </controller>
Nov 10 16:20:57 user nova-compute[75102]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='pci.0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </controller>
Nov 10 16:20:57 user nova-compute[75102]:     <controller type='ide' index='0'>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='ide'/>
Nov 10 16:20:57 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 16:20:57 user nova-compute[75102]:     </controller>
Nov 10 16:20:57 user nova-compute[75102]:     <interface type='ethernet'>
Nov 10 16:20:57 user nova-compute[75102]:       <mac address='fa:16:3e:e7:33:d1'/>
Nov 10 16:20:57 user nova-compute[75102]:       <target dev='tap85ff080c-d3'/>
Nov 10 16:20:57 user nova-compute[75102]:       <model type='virtio'/>
Nov 10 16:20:57 user nova-compute[75102]:       <mtu size='1442'/>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='net0'/>
Nov 10 16:20:57 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </interface>
Nov 10 16:20:57 user nova-compute[75102]:     <serial type='pty'>
Nov 10 16:20:57 user nova-compute[75102]:       <source path='/dev/pts/5'/>
Nov 10 16:20:57 user nova-compute[75102]:       <log file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log' append='off'/>
Nov 10 16:20:57 user nova-compute[75102]:       <target type='isa-serial' port='0'>
Nov 10 16:20:57 user nova-compute[75102]:         <model name='isa-serial'/>
Nov 10 16:20:57 user nova-compute[75102]:       </target>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='serial0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </serial>
Nov 10 16:20:57 user nova-compute[75102]:     <console type='pty' tty='/dev/pts/5'>
Nov 10 16:20:57 user nova-compute[75102]:       <source path='/dev/pts/5'/>
Nov 10 16:20:57 user nova-compute[75102]:       <log file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log' append='off'/>
Nov 10 16:20:57 user nova-compute[75102]:       <target type='serial' port='0'/>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='serial0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </console>
Nov 10 16:20:57 user nova-compute[75102]:     <input type='mouse' bus='ps2'>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='input0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </input>
Nov 10 16:20:57 user nova-compute[75102]:     <input type='keyboard' bus='ps2'>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='input1'/>
Nov 10 16:20:57 user nova-compute[75102]:     </input>
Nov 10 16:20:57 user nova-compute[75102]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 10 16:20:57 user nova-compute[75102]:       <listen type='address' address='0.0.0.0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </graphics>
Nov 10 16:20:57 user nova-compute[75102]:     <audio id='1' type='none'/>
Nov 10 16:20:57 user nova-compute[75102]:     <video>
Nov 10 16:20:57 user nova-compute[75102]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='video0'/>
Nov 10 16:20:57 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </video>
Nov 10 16:20:57 user nova-compute[75102]:     <memballoon model='virtio'>
Nov 10 16:20:57 user nova-compute[75102]:       <stats period='10'/>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='balloon0'/>
Nov 10 16:20:57 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </memballoon>
Nov 10 16:20:57 user nova-compute[75102]:     <rng model='virtio'>
Nov 10 16:20:57 user nova-compute[75102]:       <backend model='random'>/dev/urandom</backend>
Nov 10 16:20:57 user nova-compute[75102]:       <alias name='rng0'/>
Nov 10 16:20:57 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 16:20:57 user nova-compute[75102]:     </rng>
Nov 10 16:20:57 user nova-compute[75102]:   </devices>
Nov 10 16:20:57 user nova-compute[75102]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 16:20:57 user nova-compute[75102]:     <label>libvirt-73ffbf3a-c989-4165-b886-9b5b6ca94e90</label>
Nov 10 16:20:57 user nova-compute[75102]:     <imagelabel>libvirt-73ffbf3a-c989-4165-b886-9b5b6ca94e90</imagelabel>
Nov 10 16:20:57 user nova-compute[75102]:   </seclabel>
Nov 10 16:20:57 user nova-compute[75102]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 16:20:57 user nova-compute[75102]:     <label>+64055:+108</label>
Nov 10 16:20:57 user nova-compute[75102]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 16:20:57 user nova-compute[75102]:   </seclabel>
Nov 10 16:20:57 user nova-compute[75102]: </domain>
Nov 10 16:20:57 user nova-compute[75102]:  {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 16:20:57 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Successfully detached device tap04e5a27d-f5 from instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90 from the live domain config.
Nov 10 16:20:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13933405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13933405',id=6,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+qq64H5Vbjx8Inx+6yEga0vLwbJNL0epCbJdKi3Gom0oTPj8h30FZ5w3N1JQxqZvcLGfPUVHHvK4qcUmB4N/TDmyU59bYy0FuC/NEh/MF4Ce92Mb5OlPfx9teriOA4hQ==',key_name='tempest-keypair-1570286825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941ab220f5014f92940dc69ff115395d',ramdisk_id='',reservation_id='r-0ilj5ijd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-777879608',owner_user_name='tempest-TaggedAttachmentsTest-777879608-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3feb9b9df3e4b80ae23321c15848efa',uuid=73ffbf3a-c989-4165-b886-9b5b6ca94e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converting VIF {"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG os_vif [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04e5a27d-f5, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc95172e-9c4e-40d1-a93c-d8537f6db36d) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:20:57 user nova-compute[75102]: INFO os_vif [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5')
Nov 10 16:20:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:20:57 user nova-compute[75102]:   <nova:package version="0.0.0"/>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:name>tempest-device-tagging-server-13933405</nova:name>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:creationTime>2023-11-10 16:20:57</nova:creationTime>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:flavor name="m1.tiny">
Nov 10 16:20:57 user nova-compute[75102]:     <nova:memory>512</nova:memory>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:disk>1</nova:disk>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:swap>0</nova:swap>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:vcpus>1</nova:vcpus>
Nov 10 16:20:57 user nova-compute[75102]:   </nova:flavor>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:owner>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:user uuid="c3feb9b9df3e4b80ae23321c15848efa">tempest-TaggedAttachmentsTest-777879608-project-member</nova:user>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:project uuid="941ab220f5014f92940dc69ff115395d">tempest-TaggedAttachmentsTest-777879608</nova:project>
Nov 10 16:20:57 user nova-compute[75102]:   </nova:owner>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:20:57 user nova-compute[75102]:   <nova:ports>
Nov 10 16:20:57 user nova-compute[75102]:     <nova:port uuid="85ff080c-d374-4dde-aec4-b0dbd4b835b0">
Nov 10 16:20:57 user nova-compute[75102]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:20:57 user nova-compute[75102]:     </nova:port>
Nov 10 16:20:57 user nova-compute[75102]:   </nova:ports>
Nov 10 16:20:57 user nova-compute[75102]: </nova:instance>
Nov 10 16:20:57 user nova-compute[75102]:  {{(pid=75102) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-deleted-04e5a27d-f5c1-404a-b694-36e87ac2be8b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:20:58 user nova-compute[75102]: INFO nova.compute.manager [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Neutron deleted interface 04e5a27d-f5c1-404a-b694-36e87ac2be8b; detaching it from the instance and deleting it from the info cache
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.network.neutron [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updating instance_info_cache with network_info: [{"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.objects.instance [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] Lazy-loading 'system_metadata' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquired lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.objects.instance [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] Lazy-loading 'flavor' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.objects.base [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] Object Instance<73ffbf3a-c989-4165-b886-9b5b6ca94e90> lazy-loaded attributes: system_metadata,flavor {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13933405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13933405',id=6,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+qq64H5Vbjx8Inx+6yEga0vLwbJNL0epCbJdKi3Gom0oTPj8h30FZ5w3N1JQxqZvcLGfPUVHHvK4qcUmB4N/TDmyU59bYy0FuC/NEh/MF4Ce92Mb5OlPfx9teriOA4hQ==',key_name='tempest-keypair-1570286825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941ab220f5014f92940dc69ff115395d',ramdisk_id='',reservation_id='r-0ilj5ijd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-777879608',owner_user_name='tempest-TaggedAttachmentsTest-777879608-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3feb9b9df3e4b80ae23321c15848efa',uuid=73ffbf3a-c989-4165-b886-9b5b6ca94e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] Converting VIF {"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface> {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 10 16:20:58 user nova-compute[75102]:   <name>instance-00000006</name>
Nov 10 16:20:58 user nova-compute[75102]:   <uuid>73ffbf3a-c989-4165-b886-9b5b6ca94e90</uuid>
Nov 10 16:20:58 user nova-compute[75102]:   <metadata>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:20:58 user nova-compute[75102]:   <nova:package version="0.0.0"/>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:name>tempest-device-tagging-server-13933405</nova:name>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:creationTime>2023-11-10 16:20:57</nova:creationTime>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:flavor name="m1.tiny">
Nov 10 16:20:58 user nova-compute[75102]:     <nova:memory>512</nova:memory>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:disk>1</nova:disk>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:swap>0</nova:swap>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:vcpus>1</nova:vcpus>
Nov 10 16:20:58 user nova-compute[75102]:   </nova:flavor>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:owner>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:user uuid="c3feb9b9df3e4b80ae23321c15848efa">tempest-TaggedAttachmentsTest-777879608-project-member</nova:user>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:project uuid="941ab220f5014f92940dc69ff115395d">tempest-TaggedAttachmentsTest-777879608</nova:project>
Nov 10 16:20:58 user nova-compute[75102]:   </nova:owner>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:ports>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:port uuid="85ff080c-d374-4dde-aec4-b0dbd4b835b0">
Nov 10 16:20:58 user nova-compute[75102]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:20:58 user nova-compute[75102]:     </nova:port>
Nov 10 16:20:58 user nova-compute[75102]:   </nova:ports>
Nov 10 16:20:58 user nova-compute[75102]: </nova:instance>
Nov 10 16:20:58 user nova-compute[75102]:   </metadata>
Nov 10 16:20:58 user nova-compute[75102]:   <memory unit='KiB'>524288</memory>
Nov 10 16:20:58 user nova-compute[75102]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 16:20:58 user nova-compute[75102]:   <vcpu placement='static'>1</vcpu>
Nov 10 16:20:58 user nova-compute[75102]:   <resource>
Nov 10 16:20:58 user nova-compute[75102]:     <partition>/machine</partition>
Nov 10 16:20:58 user nova-compute[75102]:   </resource>
Nov 10 16:20:58 user nova-compute[75102]:   <sysinfo type='smbios'>
Nov 10 16:20:58 user nova-compute[75102]:     <system>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='version'>0.0.0</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='serial'>73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='uuid'>73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='family'>Virtual Machine</entry>
Nov 10 16:20:58 user nova-compute[75102]:     </system>
Nov 10 16:20:58 user nova-compute[75102]:   </sysinfo>
Nov 10 16:20:58 user nova-compute[75102]:   <os>
Nov 10 16:20:58 user nova-compute[75102]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 16:20:58 user nova-compute[75102]:     <boot dev='hd'/>
Nov 10 16:20:58 user nova-compute[75102]:     <smbios mode='sysinfo'/>
Nov 10 16:20:58 user nova-compute[75102]:   </os>
Nov 10 16:20:58 user nova-compute[75102]:   <features>
Nov 10 16:20:58 user nova-compute[75102]:     <acpi/>
Nov 10 16:20:58 user nova-compute[75102]:     <apic/>
Nov 10 16:20:58 user nova-compute[75102]:     <vmcoreinfo state='on'/>
Nov 10 16:20:58 user nova-compute[75102]:   </features>
Nov 10 16:20:58 user nova-compute[75102]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 16:20:58 user nova-compute[75102]:     <model fallback='forbid'>Nehalem</model>
Nov 10 16:20:58 user nova-compute[75102]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 16:20:58 user nova-compute[75102]:     <feature policy='require' name='vme'/>
Nov 10 16:20:58 user nova-compute[75102]:     <feature policy='require' name='x2apic'/>
Nov 10 16:20:58 user nova-compute[75102]:     <feature policy='require' name='hypervisor'/>
Nov 10 16:20:58 user nova-compute[75102]:   </cpu>
Nov 10 16:20:58 user nova-compute[75102]:   <clock offset='utc'>
Nov 10 16:20:58 user nova-compute[75102]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 16:20:58 user nova-compute[75102]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 16:20:58 user nova-compute[75102]:     <timer name='hpet' present='no'/>
Nov 10 16:20:58 user nova-compute[75102]:   </clock>
Nov 10 16:20:58 user nova-compute[75102]:   <on_poweroff>destroy</on_poweroff>
Nov 10 16:20:58 user nova-compute[75102]:   <on_reboot>restart</on_reboot>
Nov 10 16:20:58 user nova-compute[75102]:   <on_crash>destroy</on_crash>
Nov 10 16:20:58 user nova-compute[75102]:   <devices>
Nov 10 16:20:58 user nova-compute[75102]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 16:20:58 user nova-compute[75102]:     <disk type='file' device='disk'>
Nov 10 16:20:58 user nova-compute[75102]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 16:20:58 user nova-compute[75102]:       <source file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk' index='2'/>
Nov 10 16:20:58 user nova-compute[75102]:       <backingStore type='file' index='3'>
Nov 10 16:20:58 user nova-compute[75102]:         <format type='raw'/>
Nov 10 16:20:58 user nova-compute[75102]:         <source file='/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb'/>
Nov 10 16:20:58 user nova-compute[75102]:         <backingStore/>
Nov 10 16:20:58 user nova-compute[75102]:       </backingStore>
Nov 10 16:20:58 user nova-compute[75102]:       <target dev='vda' bus='virtio'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='virtio-disk0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </disk>
Nov 10 16:20:58 user nova-compute[75102]:     <disk type='file' device='cdrom'>
Nov 10 16:20:58 user nova-compute[75102]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 16:20:58 user nova-compute[75102]:       <source file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.config' index='1'/>
Nov 10 16:20:58 user nova-compute[75102]:       <backingStore/>
Nov 10 16:20:58 user nova-compute[75102]:       <target dev='hda' bus='ide'/>
Nov 10 16:20:58 user nova-compute[75102]:       <readonly/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='ide0-0-0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </disk>
Nov 10 16:20:58 user nova-compute[75102]:     <controller type='usb' index='0' model='none'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='usb'/>
Nov 10 16:20:58 user nova-compute[75102]:     </controller>
Nov 10 16:20:58 user nova-compute[75102]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='pci.0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </controller>
Nov 10 16:20:58 user nova-compute[75102]:     <controller type='ide' index='0'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='ide'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 16:20:58 user nova-compute[75102]:     </controller>
Nov 10 16:20:58 user nova-compute[75102]:     <interface type='ethernet'>
Nov 10 16:20:58 user nova-compute[75102]:       <mac address='fa:16:3e:e7:33:d1'/>
Nov 10 16:20:58 user nova-compute[75102]:       <target dev='tap85ff080c-d3'/>
Nov 10 16:20:58 user nova-compute[75102]:       <model type='virtio'/>
Nov 10 16:20:58 user nova-compute[75102]:       <mtu size='1442'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='net0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </interface>
Nov 10 16:20:58 user nova-compute[75102]:     <serial type='pty'>
Nov 10 16:20:58 user nova-compute[75102]:       <source path='/dev/pts/5'/>
Nov 10 16:20:58 user nova-compute[75102]:       <log file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log' append='off'/>
Nov 10 16:20:58 user nova-compute[75102]:       <target type='isa-serial' port='0'>
Nov 10 16:20:58 user nova-compute[75102]:         <model name='isa-serial'/>
Nov 10 16:20:58 user nova-compute[75102]:       </target>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='serial0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </serial>
Nov 10 16:20:58 user nova-compute[75102]:     <console type='pty' tty='/dev/pts/5'>
Nov 10 16:20:58 user nova-compute[75102]:       <source path='/dev/pts/5'/>
Nov 10 16:20:58 user nova-compute[75102]:       <log file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log' append='off'/>
Nov 10 16:20:58 user nova-compute[75102]:       <target type='serial' port='0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='serial0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </console>
Nov 10 16:20:58 user nova-compute[75102]:     <input type='mouse' bus='ps2'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='input0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </input>
Nov 10 16:20:58 user nova-compute[75102]:     <input type='keyboard' bus='ps2'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='input1'/>
Nov 10 16:20:58 user nova-compute[75102]:     </input>
Nov 10 16:20:58 user nova-compute[75102]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 10 16:20:58 user nova-compute[75102]:       <listen type='address' address='0.0.0.0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </graphics>
Nov 10 16:20:58 user nova-compute[75102]:     <audio id='1' type='none'/>
Nov 10 16:20:58 user nova-compute[75102]:     <video>
Nov 10 16:20:58 user nova-compute[75102]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='video0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </video>
Nov 10 16:20:58 user nova-compute[75102]:     <memballoon model='virtio'>
Nov 10 16:20:58 user nova-compute[75102]:       <stats period='10'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='balloon0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </memballoon>
Nov 10 16:20:58 user nova-compute[75102]:     <rng model='virtio'>
Nov 10 16:20:58 user nova-compute[75102]:       <backend model='random'>/dev/urandom</backend>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='rng0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </rng>
Nov 10 16:20:58 user nova-compute[75102]:   </devices>
Nov 10 16:20:58 user nova-compute[75102]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 16:20:58 user nova-compute[75102]:     <label>libvirt-73ffbf3a-c989-4165-b886-9b5b6ca94e90</label>
Nov 10 16:20:58 user nova-compute[75102]:     <imagelabel>libvirt-73ffbf3a-c989-4165-b886-9b5b6ca94e90</imagelabel>
Nov 10 16:20:58 user nova-compute[75102]:   </seclabel>
Nov 10 16:20:58 user nova-compute[75102]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 16:20:58 user nova-compute[75102]:     <label>+64055:+108</label>
Nov 10 16:20:58 user nova-compute[75102]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 16:20:58 user nova-compute[75102]:   </seclabel>
Nov 10 16:20:58 user nova-compute[75102]: </domain>
Nov 10 16:20:58 user nova-compute[75102]:  {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface> {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:98:36:f2"/><model type="virtio"/><mtu size="1442"/><target dev="tap04e5a27d-f5"/></interface>not found in domain: <domain type='kvm' id='6'>
Nov 10 16:20:58 user nova-compute[75102]:   <name>instance-00000006</name>
Nov 10 16:20:58 user nova-compute[75102]:   <uuid>73ffbf3a-c989-4165-b886-9b5b6ca94e90</uuid>
Nov 10 16:20:58 user nova-compute[75102]:   <metadata>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:20:58 user nova-compute[75102]:   <nova:package version="0.0.0"/>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:name>tempest-device-tagging-server-13933405</nova:name>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:creationTime>2023-11-10 16:20:57</nova:creationTime>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:flavor name="m1.tiny">
Nov 10 16:20:58 user nova-compute[75102]:     <nova:memory>512</nova:memory>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:disk>1</nova:disk>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:swap>0</nova:swap>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:vcpus>1</nova:vcpus>
Nov 10 16:20:58 user nova-compute[75102]:   </nova:flavor>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:owner>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:user uuid="c3feb9b9df3e4b80ae23321c15848efa">tempest-TaggedAttachmentsTest-777879608-project-member</nova:user>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:project uuid="941ab220f5014f92940dc69ff115395d">tempest-TaggedAttachmentsTest-777879608</nova:project>
Nov 10 16:20:58 user nova-compute[75102]:   </nova:owner>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:ports>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:port uuid="85ff080c-d374-4dde-aec4-b0dbd4b835b0">
Nov 10 16:20:58 user nova-compute[75102]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:20:58 user nova-compute[75102]:     </nova:port>
Nov 10 16:20:58 user nova-compute[75102]:   </nova:ports>
Nov 10 16:20:58 user nova-compute[75102]: </nova:instance>
Nov 10 16:20:58 user nova-compute[75102]:   </metadata>
Nov 10 16:20:58 user nova-compute[75102]:   <memory unit='KiB'>524288</memory>
Nov 10 16:20:58 user nova-compute[75102]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 10 16:20:58 user nova-compute[75102]:   <vcpu placement='static'>1</vcpu>
Nov 10 16:20:58 user nova-compute[75102]:   <resource>
Nov 10 16:20:58 user nova-compute[75102]:     <partition>/machine</partition>
Nov 10 16:20:58 user nova-compute[75102]:   </resource>
Nov 10 16:20:58 user nova-compute[75102]:   <sysinfo type='smbios'>
Nov 10 16:20:58 user nova-compute[75102]:     <system>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='product'>OpenStack Nova</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='version'>0.0.0</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='serial'>73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='uuid'>73ffbf3a-c989-4165-b886-9b5b6ca94e90</entry>
Nov 10 16:20:58 user nova-compute[75102]:       <entry name='family'>Virtual Machine</entry>
Nov 10 16:20:58 user nova-compute[75102]:     </system>
Nov 10 16:20:58 user nova-compute[75102]:   </sysinfo>
Nov 10 16:20:58 user nova-compute[75102]:   <os>
Nov 10 16:20:58 user nova-compute[75102]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 10 16:20:58 user nova-compute[75102]:     <boot dev='hd'/>
Nov 10 16:20:58 user nova-compute[75102]:     <smbios mode='sysinfo'/>
Nov 10 16:20:58 user nova-compute[75102]:   </os>
Nov 10 16:20:58 user nova-compute[75102]:   <features>
Nov 10 16:20:58 user nova-compute[75102]:     <acpi/>
Nov 10 16:20:58 user nova-compute[75102]:     <apic/>
Nov 10 16:20:58 user nova-compute[75102]:     <vmcoreinfo state='on'/>
Nov 10 16:20:58 user nova-compute[75102]:   </features>
Nov 10 16:20:58 user nova-compute[75102]:   <cpu mode='custom' match='exact' check='full'>
Nov 10 16:20:58 user nova-compute[75102]:     <model fallback='forbid'>Nehalem</model>
Nov 10 16:20:58 user nova-compute[75102]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 10 16:20:58 user nova-compute[75102]:     <feature policy='require' name='vme'/>
Nov 10 16:20:58 user nova-compute[75102]:     <feature policy='require' name='x2apic'/>
Nov 10 16:20:58 user nova-compute[75102]:     <feature policy='require' name='hypervisor'/>
Nov 10 16:20:58 user nova-compute[75102]:   </cpu>
Nov 10 16:20:58 user nova-compute[75102]:   <clock offset='utc'>
Nov 10 16:20:58 user nova-compute[75102]:     <timer name='pit' tickpolicy='delay'/>
Nov 10 16:20:58 user nova-compute[75102]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 10 16:20:58 user nova-compute[75102]:     <timer name='hpet' present='no'/>
Nov 10 16:20:58 user nova-compute[75102]:   </clock>
Nov 10 16:20:58 user nova-compute[75102]:   <on_poweroff>destroy</on_poweroff>
Nov 10 16:20:58 user nova-compute[75102]:   <on_reboot>restart</on_reboot>
Nov 10 16:20:58 user nova-compute[75102]:   <on_crash>destroy</on_crash>
Nov 10 16:20:58 user nova-compute[75102]:   <devices>
Nov 10 16:20:58 user nova-compute[75102]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 10 16:20:58 user nova-compute[75102]:     <disk type='file' device='disk'>
Nov 10 16:20:58 user nova-compute[75102]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 10 16:20:58 user nova-compute[75102]:       <source file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk' index='2'/>
Nov 10 16:20:58 user nova-compute[75102]:       <backingStore type='file' index='3'>
Nov 10 16:20:58 user nova-compute[75102]:         <format type='raw'/>
Nov 10 16:20:58 user nova-compute[75102]:         <source file='/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb'/>
Nov 10 16:20:58 user nova-compute[75102]:         <backingStore/>
Nov 10 16:20:58 user nova-compute[75102]:       </backingStore>
Nov 10 16:20:58 user nova-compute[75102]:       <target dev='vda' bus='virtio'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='virtio-disk0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </disk>
Nov 10 16:20:58 user nova-compute[75102]:     <disk type='file' device='cdrom'>
Nov 10 16:20:58 user nova-compute[75102]:       <driver name='qemu' type='raw' cache='none'/>
Nov 10 16:20:58 user nova-compute[75102]:       <source file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/disk.config' index='1'/>
Nov 10 16:20:58 user nova-compute[75102]:       <backingStore/>
Nov 10 16:20:58 user nova-compute[75102]:       <target dev='hda' bus='ide'/>
Nov 10 16:20:58 user nova-compute[75102]:       <readonly/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='ide0-0-0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </disk>
Nov 10 16:20:58 user nova-compute[75102]:     <controller type='usb' index='0' model='none'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='usb'/>
Nov 10 16:20:58 user nova-compute[75102]:     </controller>
Nov 10 16:20:58 user nova-compute[75102]:     <controller type='pci' index='0' model='pci-root'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='pci.0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </controller>
Nov 10 16:20:58 user nova-compute[75102]:     <controller type='ide' index='0'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='ide'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 10 16:20:58 user nova-compute[75102]:     </controller>
Nov 10 16:20:58 user nova-compute[75102]:     <interface type='ethernet'>
Nov 10 16:20:58 user nova-compute[75102]:       <mac address='fa:16:3e:e7:33:d1'/>
Nov 10 16:20:58 user nova-compute[75102]:       <target dev='tap85ff080c-d3'/>
Nov 10 16:20:58 user nova-compute[75102]:       <model type='virtio'/>
Nov 10 16:20:58 user nova-compute[75102]:       <mtu size='1442'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='net0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </interface>
Nov 10 16:20:58 user nova-compute[75102]:     <serial type='pty'>
Nov 10 16:20:58 user nova-compute[75102]:       <source path='/dev/pts/5'/>
Nov 10 16:20:58 user nova-compute[75102]:       <log file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log' append='off'/>
Nov 10 16:20:58 user nova-compute[75102]:       <target type='isa-serial' port='0'>
Nov 10 16:20:58 user nova-compute[75102]:         <model name='isa-serial'/>
Nov 10 16:20:58 user nova-compute[75102]:       </target>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='serial0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </serial>
Nov 10 16:20:58 user nova-compute[75102]:     <console type='pty' tty='/dev/pts/5'>
Nov 10 16:20:58 user nova-compute[75102]:       <source path='/dev/pts/5'/>
Nov 10 16:20:58 user nova-compute[75102]:       <log file='/opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90/console.log' append='off'/>
Nov 10 16:20:58 user nova-compute[75102]:       <target type='serial' port='0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='serial0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </console>
Nov 10 16:20:58 user nova-compute[75102]:     <input type='mouse' bus='ps2'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='input0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </input>
Nov 10 16:20:58 user nova-compute[75102]:     <input type='keyboard' bus='ps2'>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='input1'/>
Nov 10 16:20:58 user nova-compute[75102]:     </input>
Nov 10 16:20:58 user nova-compute[75102]:     <graphics type='vnc' port='5905' autoport='yes' listen='0.0.0.0'>
Nov 10 16:20:58 user nova-compute[75102]:       <listen type='address' address='0.0.0.0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </graphics>
Nov 10 16:20:58 user nova-compute[75102]:     <audio id='1' type='none'/>
Nov 10 16:20:58 user nova-compute[75102]:     <video>
Nov 10 16:20:58 user nova-compute[75102]:       <model type='virtio' heads='1' primary='yes'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='video0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </video>
Nov 10 16:20:58 user nova-compute[75102]:     <memballoon model='virtio'>
Nov 10 16:20:58 user nova-compute[75102]:       <stats period='10'/>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='balloon0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </memballoon>
Nov 10 16:20:58 user nova-compute[75102]:     <rng model='virtio'>
Nov 10 16:20:58 user nova-compute[75102]:       <backend model='random'>/dev/urandom</backend>
Nov 10 16:20:58 user nova-compute[75102]:       <alias name='rng0'/>
Nov 10 16:20:58 user nova-compute[75102]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 10 16:20:58 user nova-compute[75102]:     </rng>
Nov 10 16:20:58 user nova-compute[75102]:   </devices>
Nov 10 16:20:58 user nova-compute[75102]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 10 16:20:58 user nova-compute[75102]:     <label>libvirt-73ffbf3a-c989-4165-b886-9b5b6ca94e90</label>
Nov 10 16:20:58 user nova-compute[75102]:     <imagelabel>libvirt-73ffbf3a-c989-4165-b886-9b5b6ca94e90</imagelabel>
Nov 10 16:20:58 user nova-compute[75102]:   </seclabel>
Nov 10 16:20:58 user nova-compute[75102]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 10 16:20:58 user nova-compute[75102]:     <label>+64055:+108</label>
Nov 10 16:20:58 user nova-compute[75102]:     <imagelabel>+64055:+108</imagelabel>
Nov 10 16:20:58 user nova-compute[75102]:   </seclabel>
Nov 10 16:20:58 user nova-compute[75102]: </domain>
Nov 10 16:20:58 user nova-compute[75102]:  {{(pid=75102) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 10 16:20:58 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Detaching interface fa:16:3e:98:36:f2 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap04e5a27d-f5' not found.
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13933405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13933405',id=6,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+qq64H5Vbjx8Inx+6yEga0vLwbJNL0epCbJdKi3Gom0oTPj8h30FZ5w3N1JQxqZvcLGfPUVHHvK4qcUmB4N/TDmyU59bYy0FuC/NEh/MF4Ce92Mb5OlPfx9teriOA4hQ==',key_name='tempest-keypair-1570286825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941ab220f5014f92940dc69ff115395d',ramdisk_id='',reservation_id='r-0ilj5ijd',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-777879608',owner_user_name='tempest-TaggedAttachmentsTest-777879608-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3feb9b9df3e4b80ae23321c15848efa',uuid=73ffbf3a-c989-4165-b886-9b5b6ca94e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] Converting VIF {"id": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "address": "fa:16:3e:98:36:f2", "network": {"id": "fdfd596c-8bfa-48b1-9f38-8d230925f271", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1364693065", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.69", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap04e5a27d-f5", "ovs_interfaceid": "04e5a27d-f5c1-404a-b694-36e87ac2be8b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG os_vif [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap04e5a27d-f5, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:20:58 user nova-compute[75102]: INFO os_vif [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:36:f2,bridge_name='br-int',has_traffic_filtering=True,id=04e5a27d-f5c1-404a-b694-36e87ac2be8b,network=Network(fdfd596c-8bfa-48b1-9f38-8d230925f271),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap04e5a27d-f5')
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [req-3bac9d73-ff77-488a-8c15-734136ebf826 req-cffcc101-ba4e-4c93-b37c-2ef05664bed1 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:20:58 user nova-compute[75102]:   <nova:package version="0.0.0"/>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:name>tempest-device-tagging-server-13933405</nova:name>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:creationTime>2023-11-10 16:20:58</nova:creationTime>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:flavor name="m1.tiny">
Nov 10 16:20:58 user nova-compute[75102]:     <nova:memory>512</nova:memory>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:disk>1</nova:disk>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:swap>0</nova:swap>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:vcpus>1</nova:vcpus>
Nov 10 16:20:58 user nova-compute[75102]:   </nova:flavor>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:owner>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:user uuid="c3feb9b9df3e4b80ae23321c15848efa">tempest-TaggedAttachmentsTest-777879608-project-member</nova:user>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:project uuid="941ab220f5014f92940dc69ff115395d">tempest-TaggedAttachmentsTest-777879608</nova:project>
Nov 10 16:20:58 user nova-compute[75102]:   </nova:owner>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:20:58 user nova-compute[75102]:   <nova:ports>
Nov 10 16:20:58 user nova-compute[75102]:     <nova:port uuid="85ff080c-d374-4dde-aec4-b0dbd4b835b0">
Nov 10 16:20:58 user nova-compute[75102]:       <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:20:58 user nova-compute[75102]:     </nova:port>
Nov 10 16:20:58 user nova-compute[75102]:   </nova:ports>
Nov 10 16:20:58 user nova-compute[75102]: </nova:instance>
Nov 10 16:20:58 user nova-compute[75102]:  {{(pid=75102) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updating instance_info_cache with network_info: [{"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Releasing lock "refresh_cache-73ffbf3a-c989-4165-b886-9b5b6ca94e90" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-43b426a7-480f-4a2d-a6a4-2b32d5e429a8 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "interface-73ffbf3a-c989-4165-b886-9b5b6ca94e90-04e5a27d-f5c1-404a-b694-36e87ac2be8b" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.747s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:20:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 req-5daaae8c-4c57-4b45-9f56-fdea4a3d6c0d service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event volume-reimaged-aefc9e87-7a41-45fe-97a7-113f4a673159 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 req-5daaae8c-4c57-4b45-9f56-fdea4a3d6c0d service nova] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 req-5daaae8c-4c57-4b45-9f56-fdea4a3d6c0d service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 req-5daaae8c-4c57-4b45-9f56-fdea4a3d6c0d service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 req-5daaae8c-4c57-4b45-9f56-fdea4a3d6c0d service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Processing event volume-reimaged-aefc9e87-7a41-45fe-97a7-113f4a673159 {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance event wait completed in 55 seconds for volume-reimaged {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:07 user nova-compute[75102]: INFO nova.virt.block_device [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Booting with volume aefc9e87-7a41-45fe-97a7-113f4a673159 at /dev/vda
Nov 10 16:21:07 user nova-compute[75102]: DEBUG os_brick.utils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc55058e-1db7-49ee-a501-946c3e4c40f1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e955d4fe-d60f-4992-8ce4-3cabf6ed471e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dea9cc8-53e4-4b6e-a605-4a06b8ef9834]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd7b0d1a-1eee-4721-b9b3-48ed82eb4a49]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:21:07 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:21:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[961e929f-3c7b-46ca-95ab-c2fe4ffaf853]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG os_brick.utils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:21:07 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Updating existing volume attachment record: 0a1bee94-176c-4b57-9e3f-cd2dc7d1658d {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:21:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:14 user nova-compute[75102]: INFO nova.compute.manager [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Terminating instance
Nov 10 16:21:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-c4e8f5fb-8cd6-4dbf-9775-e475189a352f req-599ef693-86c0-4c24-9d64-5a9962223add service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received event network-vif-unplugged-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c4e8f5fb-8cd6-4dbf-9775-e475189a352f req-599ef693-86c0-4c24-9d64-5a9962223add service nova] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c4e8f5fb-8cd6-4dbf-9775-e475189a352f req-599ef693-86c0-4c24-9d64-5a9962223add service nova] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c4e8f5fb-8cd6-4dbf-9775-e475189a352f req-599ef693-86c0-4c24-9d64-5a9962223add service nova] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-c4e8f5fb-8cd6-4dbf-9775-e475189a352f req-599ef693-86c0-4c24-9d64-5a9962223add service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] No waiting events found dispatching network-vif-unplugged-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-c4e8f5fb-8cd6-4dbf-9775-e475189a352f req-599ef693-86c0-4c24-9d64-5a9962223add service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received event network-vif-unplugged-d9965142-35ab-44e0-82bc-b3e8099c58ad for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:21:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Instance destroyed successfully.
Nov 10 16:21:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lazy-loading 'resources' on Instance uuid 83ad82f3-4e34-46fd-94a6-71adb8884eda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:16:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-908239677',display_name='tempest-VolumesAssistedSnapshotsTest-server-908239677',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-908239677',id=5,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTXCDjnhkUxFfKOhd5giJVqvsNp9rhiLlvtXOgpcbhyMOC7DZIwLO/Ju71GBvfWBmAHdOYb3UzJ4VZhhSdXi1NYqROmv3YiPKSGThT9p9tqcQz8sd4YulkrZS5RqL9S6Q==',key_name='tempest-keypair-1951149358',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0ee93b8e5c4a41f6bf60c6b1e8b2f481',ramdisk_id='',reservation_id='r-iu81dcoj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-725875834',owner_user_name='tempest-VolumesAssistedSnapshotsTest-725875834-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1899a5a4fd34eff90dfe1e462e3ac9c',uuid=83ad82f3-4e34-46fd-94a6-71adb8884eda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Converting VIF {"id": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "address": "fa:16:3e:05:fa:9a", "network": {"id": "eee502f0-b9d7-4872-b58d-927cfbaa1b49", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-487769848-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.18", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0ee93b8e5c4a41f6bf60c6b1e8b2f481", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd9965142-35", "ovs_interfaceid": "d9965142-35ab-44e0-82bc-b3e8099c58ad", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:05:fa:9a,bridge_name='br-int',has_traffic_filtering=True,id=d9965142-35ab-44e0-82bc-b3e8099c58ad,network=Network(eee502f0-b9d7-4872-b58d-927cfbaa1b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9965142-35') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG os_vif [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:fa:9a,bridge_name='br-int',has_traffic_filtering=True,id=d9965142-35ab-44e0-82bc-b3e8099c58ad,network=Network(eee502f0-b9d7-4872-b58d-927cfbaa1b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9965142-35') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd9965142-35, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a13300c-b31b-4100-9fea-adbb66001ef0) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:15 user nova-compute[75102]: INFO os_vif [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:05:fa:9a,bridge_name='br-int',has_traffic_filtering=True,id=d9965142-35ab-44e0-82bc-b3e8099c58ad,network=Network(eee502f0-b9d7-4872-b58d-927cfbaa1b49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd9965142-35')
Nov 10 16:21:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Deleting instance files /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda_del
Nov 10 16:21:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Deletion of /opt/stack/data/nova/instances/83ad82f3-4e34-46fd-94a6-71adb8884eda_del complete
Nov 10 16:21:15 user nova-compute[75102]: INFO nova.compute.manager [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 10 16:21:15 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:21:15 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:21:15 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Took 0.72 seconds to deallocate network for instance.
Nov 10 16:21:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-ace8f5a6-a0f7-4093-9876-d4b423b19a58 req-feeb4b69-d5d6-41ed-96ae-65cc2360059a service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received event network-vif-deleted-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.367s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:16 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Deleted allocations for instance 83ad82f3-4e34-46fd-94a6-71adb8884eda
Nov 10 16:21:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5501408f-31af-40d3-b695-9c33cb90fa67 tempest-VolumesAssistedSnapshotsTest-725875834 tempest-VolumesAssistedSnapshotsTest-725875834-project-member] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.580s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-faa2b498-8893-4b60-89ba-410ce0bc57d5 req-438dc6dc-c9ef-45f1-b0b5-6d1260e665d2 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received event network-vif-plugged-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-faa2b498-8893-4b60-89ba-410ce0bc57d5 req-438dc6dc-c9ef-45f1-b0b5-6d1260e665d2 service nova] Acquiring lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-faa2b498-8893-4b60-89ba-410ce0bc57d5 req-438dc6dc-c9ef-45f1-b0b5-6d1260e665d2 service nova] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-faa2b498-8893-4b60-89ba-410ce0bc57d5 req-438dc6dc-c9ef-45f1-b0b5-6d1260e665d2 service nova] Lock "83ad82f3-4e34-46fd-94a6-71adb8884eda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-faa2b498-8893-4b60-89ba-410ce0bc57d5 req-438dc6dc-c9ef-45f1-b0b5-6d1260e665d2 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] No waiting events found dispatching network-vif-plugged-d9965142-35ab-44e0-82bc-b3e8099c58ad {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:16 user nova-compute[75102]: WARNING nova.compute.manager [req-faa2b498-8893-4b60-89ba-410ce0bc57d5 req-438dc6dc-c9ef-45f1-b0b5-6d1260e665d2 service nova] [instance: 83ad82f3-4e34-46fd-94a6-71adb8884eda] Received unexpected event network-vif-plugged-d9965142-35ab-44e0-82bc-b3e8099c58ad for instance with vm_state deleted and task_state None.
Nov 10 16:21:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:28 user nova-compute[75102]: INFO nova.compute.manager [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Terminating instance
Nov 10 16:21:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Instance destroyed successfully.
Nov 10 16:21:28 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lazy-loading 'resources' on Instance uuid 73ffbf3a-c989-4165-b886-9b5b6ca94e90 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:16:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-13933405',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-13933405',id=6,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE+qq64H5Vbjx8Inx+6yEga0vLwbJNL0epCbJdKi3Gom0oTPj8h30FZ5w3N1JQxqZvcLGfPUVHHvK4qcUmB4N/TDmyU59bYy0FuC/NEh/MF4Ce92Mb5OlPfx9teriOA4hQ==',key_name='tempest-keypair-1570286825',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='941ab220f5014f92940dc69ff115395d',ramdisk_id='',reservation_id='r-0ilj5ijd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-777879608',owner_user_name='tempest-TaggedAttachmentsTest-777879608-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c3feb9b9df3e4b80ae23321c15848efa',uuid=73ffbf3a-c989-4165-b886-9b5b6ca94e90,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converting VIF {"id": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "address": "fa:16:3e:e7:33:d1", "network": {"id": "4262c76e-72f1-4a99-a604-f4ef12aff5a1", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-786349510-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "941ab220f5014f92940dc69ff115395d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85ff080c-d3", "ovs_interfaceid": "85ff080c-d374-4dde-aec4-b0dbd4b835b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=85ff080c-d374-4dde-aec4-b0dbd4b835b0,network=Network(4262c76e-72f1-4a99-a604-f4ef12aff5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ff080c-d3') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG os_vif [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=85ff080c-d374-4dde-aec4-b0dbd4b835b0,network=Network(4262c76e-72f1-4a99-a604-f4ef12aff5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ff080c-d3') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85ff080c-d3, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=16a4ce28-2272-4e46-a1a4-5e83c3530d57) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:28 user nova-compute[75102]: INFO os_vif [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:33:d1,bridge_name='br-int',has_traffic_filtering=True,id=85ff080c-d374-4dde-aec4-b0dbd4b835b0,network=Network(4262c76e-72f1-4a99-a604-f4ef12aff5a1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85ff080c-d3')
Nov 10 16:21:28 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Deleting instance files /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90_del
Nov 10 16:21:28 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Deletion of /opt/stack/data/nova/instances/73ffbf3a-c989-4165-b886-9b5b6ca94e90_del complete
Nov 10 16:21:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-9a6dc5aa-3783-4342-9a9b-24277ca1d3ff req-9f763c0b-9fe6-4f59-b09a-18ec23aa7785 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-unplugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9a6dc5aa-3783-4342-9a9b-24277ca1d3ff req-9f763c0b-9fe6-4f59-b09a-18ec23aa7785 service nova] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9a6dc5aa-3783-4342-9a9b-24277ca1d3ff req-9f763c0b-9fe6-4f59-b09a-18ec23aa7785 service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9a6dc5aa-3783-4342-9a9b-24277ca1d3ff req-9f763c0b-9fe6-4f59-b09a-18ec23aa7785 service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-9a6dc5aa-3783-4342-9a9b-24277ca1d3ff req-9f763c0b-9fe6-4f59-b09a-18ec23aa7785 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] No waiting events found dispatching network-vif-unplugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-9a6dc5aa-3783-4342-9a9b-24277ca1d3ff req-9f763c0b-9fe6-4f59-b09a-18ec23aa7785 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-unplugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:21:29 user nova-compute[75102]: INFO nova.compute.manager [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 10 16:21:29 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:21:29 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:21:29 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:21:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:29 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:21:29 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Took 0.92 seconds to deallocate network for instance.
Nov 10 16:21:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-fd4dca66-9f9c-4c85-b3c5-659a78ad3259 req-2ca3e7c4-3d43-4f2c-b128-09245df38c67 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-deleted-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:30 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:21:30 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:21:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.319s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:30 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Deleted allocations for instance 73ffbf3a-c989-4165-b886-9b5b6ca94e90
Nov 10 16:21:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c256c0c4-4d41-47b0-a038-1568ffce88b3 tempest-TaggedAttachmentsTest-777879608 tempest-TaggedAttachmentsTest-777879608-project-member] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.374s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-ba3452a7-e667-4ea8-8ba6-a89108f08592 req-969616db-b18a-4cbc-a716-a02e9ca82250 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received event network-vif-plugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ba3452a7-e667-4ea8-8ba6-a89108f08592 req-969616db-b18a-4cbc-a716-a02e9ca82250 service nova] Acquiring lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ba3452a7-e667-4ea8-8ba6-a89108f08592 req-969616db-b18a-4cbc-a716-a02e9ca82250 service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ba3452a7-e667-4ea8-8ba6-a89108f08592 req-969616db-b18a-4cbc-a716-a02e9ca82250 service nova] Lock "73ffbf3a-c989-4165-b886-9b5b6ca94e90-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-ba3452a7-e667-4ea8-8ba6-a89108f08592 req-969616db-b18a-4cbc-a716-a02e9ca82250 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] No waiting events found dispatching network-vif-plugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:31 user nova-compute[75102]: WARNING nova.compute.manager [req-ba3452a7-e667-4ea8-8ba6-a89108f08592 req-969616db-b18a-4cbc-a716-a02e9ca82250 service nova] [instance: 73ffbf3a-c989-4165-b886-9b5b6ca94e90] Received unexpected event network-vif-plugged-85ff080c-d374-4dde-aec4-b0dbd4b835b0 for instance with vm_state deleted and task_state None.
Nov 10 16:21:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:21:33 user nova-compute[75102]: INFO nova.compute.claims [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Claim successful on node user
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.network.neutron [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:21:33 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.policy [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '319edcb7db814fecbf84302d7f9b67c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1800117728a94e2fab455d8c365f6be5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:21:33 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Creating image(s)
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "/opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "/opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "/opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk 1073741824" returned: 0 in 0.072s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:34 user nova-compute[75102]: INFO nova.compute.manager [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Rescuing
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquired lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG nova.network.neutron [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Cannot resize image /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Ensure instance console log exists: /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:34 user nova-compute[75102]: DEBUG nova.network.neutron [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Successfully created port: 08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG nova.network.neutron [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updating instance_info_cache with network_info: [{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Releasing lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:21:35 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:21:35 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:21:35 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6707b138-a1e5-48ac-a32b-a52e781346ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:21:35 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5780eb51-48c6-4a9e-8ba7-fb893739a642]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788] added
Nov 10 16:21:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ed70a-0fa7-41f1-88ba-8c794dab9e29]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce530a74-3fdd-4fb2-b0cd-3ddd9d2b82b1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClnYeBIV {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClnYeBIV" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[29204dcc-542d-4629-921f-9fc7c4faf333]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ClnYeBIV'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e2b64b-d36d-4287-a7ac-086c66cb090c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[48510f5f-6a74-4098-ac08-51ccca9bef02]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d4ef18-b680-4083-bb88-012d36847c04]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]
Nov 10 16:21:35 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.
Nov 10 16:21:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0516703a-3dc1-4a43-ab67-ca661ed98f2c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3055d468-a2ef-46c0-ba8e-70b0bf7dd423]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:35 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:35 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.326s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd255ab7-16f4-4798-9ec6-aef9e054b825]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:21:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.network.neutron [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Successfully updated port: 08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "refresh_cache-5690a54a-d70d-4342-8838-5ea22588c5ef" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquired lock "refresh_cache-5690a54a-d70d-4342-8838-5ea22588c5ef" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.network.neutron [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-b10c64b6-0a72-44a4-9771-9e5ee206af29 req-535cc3a7-4428-4dd4-8d64-11dbb7483098 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received event network-changed-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-b10c64b6-0a72-44a4-9771-9e5ee206af29 req-535cc3a7-4428-4dd4-8d64-11dbb7483098 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Refreshing instance network info cache due to event network-changed-08be21b4-29e4-47eb-a6b9-6453851133d2. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b10c64b6-0a72-44a4-9771-9e5ee206af29 req-535cc3a7-4428-4dd4-8d64-11dbb7483098 service nova] Acquiring lock "refresh_cache-5690a54a-d70d-4342-8838-5ea22588c5ef" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.network.neutron [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:21:36 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Instance destroyed successfully.
Nov 10 16:21:36 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Attempting a stable device rescue
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75102) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Instance directory exists: not creating {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 16:21:36 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Creating image(s)
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "/opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "/opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "/opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.objects.instance [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'trusted_certs' on Instance uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "e3b6cfd187b984b776c5d8a6e86927a773cec405" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "e3b6cfd187b984b776c5d8a6e86927a773cec405" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.network.neutron [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Updating instance_info_cache with network_info: [{"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Releasing lock "refresh_cache-5690a54a-d70d-4342-8838-5ea22588c5ef" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Instance network_info: |[{"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b10c64b6-0a72-44a4-9771-9e5ee206af29 req-535cc3a7-4428-4dd4-8d64-11dbb7483098 service nova] Acquired lock "refresh_cache-5690a54a-d70d-4342-8838-5ea22588c5ef" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.network.neutron [req-b10c64b6-0a72-44a4-9771-9e5ee206af29 req-535cc3a7-4428-4dd4-8d64-11dbb7483098 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Refreshing network info cache for port 08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:21:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Start _get_guest_xml network_info=[{"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:21:36 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:21:36 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:21:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405.part --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.146s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] <== connect_volume: return (2148ms) {'type': 'block', 'scsi_wwn': '26161313932616364', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161313932616364', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-cf3215b1-fb17-4e3b-8969-94101cfa860c req-16894b91-b4c2-4eed-9eb9-4024a6104223 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-unplugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-cf3215b1-fb17-4e3b-8969-94101cfa860c req-16894b91-b4c2-4eed-9eb9-4024a6104223 service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-cf3215b1-fb17-4e3b-8969-94101cfa860c req-16894b91-b4c2-4eed-9eb9-4024a6104223 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-cf3215b1-fb17-4e3b-8969-94101cfa860c req-16894b91-b4c2-4eed-9eb9-4024a6104223 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-cf3215b1-fb17-4e3b-8969-94101cfa860c req-16894b91-b4c2-4eed-9eb9-4024a6104223 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-unplugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:37 user nova-compute[75102]: WARNING nova.compute.manager [req-cf3215b1-fb17-4e3b-8969-94101cfa860c req-16894b91-b4c2-4eed-9eb9-4024a6104223 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-unplugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state active and task_state rescuing.
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1386595591',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1386595591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1386595',id=12,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQzKpFMQ9h4E7MZxGawxcejUj+zPAiqhrS55gu6qeIvAWnwp5+sjvfSCnNz6TPy0xfGRmHV0DKURAcV+kwkGjcbS0Btz3rYtbhw6jav/uO8OYhRJWjouu79LY4E5IPqWg==',key_name='tempest-keypair-1817470167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1800117728a94e2fab455d8c365f6be5',ramdisk_id='',reservation_id='r-7dbao0jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-610146322',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:21:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319edcb7db814fecbf84302d7f9b67c3',uuid=5690a54a-d70d-4342-8838-5ea22588c5ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Converting VIF {"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:ad:1c,bridge_name='br-int',has_traffic_filtering=True,id=08be21b4-29e4-47eb-a6b9-6453851133d2,network=Network(34335d1b-ca66-4cb6-adfc-e3499e9abe46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be21b4-29') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.objects.instance [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lazy-loading 'pci_devices' on Instance uuid 5690a54a-d70d-4342-8838-5ea22588c5ef {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.objects.instance [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lazy-loading 'flavor' on Instance uuid 731624eb-b0c0-42c1-80cf-2dd76932e92a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:21:37 user nova-compute[75102]:   <uuid>5690a54a-d70d-4342-8838-5ea22588c5ef</uuid>
Nov 10 16:21:37 user nova-compute[75102]:   <name>instance-0000000c</name>
Nov 10 16:21:37 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:21:37 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:21:37 user nova-compute[75102]:   <metadata>
Nov 10 16:21:37 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:21:37 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:21:37 user nova-compute[75102]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-1386595591</nova:name>
Nov 10 16:21:37 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:21:36</nova:creationTime>
Nov 10 16:21:37 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:21:37 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:21:37 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:21:37 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:21:37 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:21:37 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:21:37 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:21:37 user nova-compute[75102]:       <nova:owner>
Nov 10 16:21:37 user nova-compute[75102]:         <nova:user uuid="319edcb7db814fecbf84302d7f9b67c3">tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member</nova:user>
Nov 10 16:21:37 user nova-compute[75102]:         <nova:project uuid="1800117728a94e2fab455d8c365f6be5">tempest-TestServerVolumeAttachScenarioOldVersion-610146322</nova:project>
Nov 10 16:21:37 user nova-compute[75102]:       </nova:owner>
Nov 10 16:21:37 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:21:37 user nova-compute[75102]:       <nova:ports>
Nov 10 16:21:37 user nova-compute[75102]:         <nova:port uuid="08be21b4-29e4-47eb-a6b9-6453851133d2">
Nov 10 16:21:37 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 16:21:37 user nova-compute[75102]:         </nova:port>
Nov 10 16:21:37 user nova-compute[75102]:       </nova:ports>
Nov 10 16:21:37 user nova-compute[75102]:     </nova:instance>
Nov 10 16:21:37 user nova-compute[75102]:   </metadata>
Nov 10 16:21:37 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:21:37 user nova-compute[75102]:     <system>
Nov 10 16:21:37 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:21:37 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:21:37 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:21:37 user nova-compute[75102]:       <entry name="serial">5690a54a-d70d-4342-8838-5ea22588c5ef</entry>
Nov 10 16:21:37 user nova-compute[75102]:       <entry name="uuid">5690a54a-d70d-4342-8838-5ea22588c5ef</entry>
Nov 10 16:21:37 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:21:37 user nova-compute[75102]:     </system>
Nov 10 16:21:37 user nova-compute[75102]:   </sysinfo>
Nov 10 16:21:37 user nova-compute[75102]:   <os>
Nov 10 16:21:37 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:21:37 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:21:37 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:21:37 user nova-compute[75102]:   </os>
Nov 10 16:21:37 user nova-compute[75102]:   <features>
Nov 10 16:21:37 user nova-compute[75102]:     <acpi/>
Nov 10 16:21:37 user nova-compute[75102]:     <apic/>
Nov 10 16:21:37 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:21:37 user nova-compute[75102]:   </features>
Nov 10 16:21:37 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:21:37 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:21:37 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:21:37 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:21:37 user nova-compute[75102]:   </clock>
Nov 10 16:21:37 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:21:37 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:21:37 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:21:37 user nova-compute[75102]:   </cpu>
Nov 10 16:21:37 user nova-compute[75102]:   <devices>
Nov 10 16:21:37 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:21:37 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:21:37 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk"/>
Nov 10 16:21:37 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:21:37 user nova-compute[75102]:     </disk>
Nov 10 16:21:37 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:21:37 user nova-compute[75102]:       <mac address="fa:16:3e:77:ad:1c"/>
Nov 10 16:21:37 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:21:37 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:21:37 user nova-compute[75102]:       <target dev="tap08be21b4-29"/>
Nov 10 16:21:37 user nova-compute[75102]:     </interface>
Nov 10 16:21:37 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:21:37 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/console.log" append="off"/>
Nov 10 16:21:37 user nova-compute[75102]:     </serial>
Nov 10 16:21:37 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:21:37 user nova-compute[75102]:     <video>
Nov 10 16:21:37 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:21:37 user nova-compute[75102]:     </video>
Nov 10 16:21:37 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:21:37 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:21:37 user nova-compute[75102]:     </rng>
Nov 10 16:21:37 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:21:37 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:21:37 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:21:37 user nova-compute[75102]:     </memballoon>
Nov 10 16:21:37 user nova-compute[75102]:   </devices>
Nov 10 16:21:37 user nova-compute[75102]: </domain>
Nov 10 16:21:37 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1386595591',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1386595591',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1386595',id=12,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQzKpFMQ9h4E7MZxGawxcejUj+zPAiqhrS55gu6qeIvAWnwp5+sjvfSCnNz6TPy0xfGRmHV0DKURAcV+kwkGjcbS0Btz3rYtbhw6jav/uO8OYhRJWjouu79LY4E5IPqWg==',key_name='tempest-keypair-1817470167',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1800117728a94e2fab455d8c365f6be5',ramdisk_id='',reservation_id='r-7dbao0jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-610146322',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:21:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319edcb7db814fecbf84302d7f9b67c3',uuid=5690a54a-d70d-4342-8838-5ea22588c5ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Converting VIF {"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:ad:1c,bridge_name='br-int',has_traffic_filtering=True,id=08be21b4-29e4-47eb-a6b9-6453851133d2,network=Network(34335d1b-ca66-4cb6-adfc-e3499e9abe46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be21b4-29') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG os_vif [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ad:1c,bridge_name='br-int',has_traffic_filtering=True,id=08be21b4-29e4-47eb-a6b9-6453851133d2,network=Network(34335d1b-ca66-4cb6-adfc-e3499e9abe46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be21b4-29') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '676307b9-a4d7-5e03-9a25-0425153bee5d', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:21:37 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:21:37 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:21:37 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:21:37 user nova-compute[75102]:   <serial>16c3c027-57d4-46aa-a334-ac1fbdf77788</serial>
Nov 10 16:21:37 user nova-compute[75102]: </disk>
Nov 10 16:21:37 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.virt.images [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] b9aefc7f-fda1-44c1-b718-2e8f90d5c2ae was qcow2, converting to raw {{(pid=75102) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405.part /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405.converted {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap08be21b4-29, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap08be21b4-29, col_values=(('qos', UUID('99de9c00-ab76-4178-a76b-d56e2679a958')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap08be21b4-29, col_values=(('external_ids', {'iface-id': '08be21b4-29e4-47eb-a6b9-6453851133d2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:ad:1c', 'vm-uuid': '5690a54a-d70d-4342-8838-5ea22588c5ef'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:21:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:37 user nova-compute[75102]: INFO os_vif [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:ad:1c,bridge_name='br-int',has_traffic_filtering=True,id=08be21b4-29e4-47eb-a6b9-6453851133d2,network=Network(34335d1b-ca66-4cb6-adfc-e3499e9abe46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be21b4-29')
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:21:38 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Creating image(s)
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Ensure instance console log exists: /opt/stack/data/nova/instances/6458fc11-6612-4108-addd-ce61d935431e/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Start _get_guest_xml network_info=[{"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '0a1bee94-176c-4b57-9e3f-cd2dc7d1658d', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMVPuJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6458fc11-6612-4108-addd-ce61d935431e', 'attached_at': '', 'detached_at': '', 'volume_id': 'aefc9e87-7a41-45fe-97a7-113f4a673159', 'serial': 'aefc9e87-7a41-45fe-97a7-113f4a673159'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:21:38 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 16:21:38 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] No VIF found with MAC fa:16:3e:77:ad:1c, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6458fc11-6612-4108-addd-ce61d935431e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMVPuJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:21:38 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:21:38 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:21:38 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260" returned: 21 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e511989b-fee2-4bbc-981d-e9985f2e690b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:21:38 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] No VIF found with MAC fa:16:3e:f8:94:15, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[49965073-e0f2-4d70-8be1-ba4d06226343]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159] added
Nov 10 16:21:38 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.067s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5cd6f0-57e8-4fcb-9ccc-2e5d72e261e0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.039s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f01cf36c-f31c-446e-b573-6dd07252e055]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMVPuJeX {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DMVPuJeX" returned: 0 in 0.053s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee3d67b-1ce0-47fe-8ed0-0bbe43ddbf18]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DMVPuJeX'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d46461-3304-49fd-b86b-a2f17a60cc48]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e50f9346-20ce-4653-9026-4b83c61a6d53]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:38 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:38 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --login" returned: 0 in 0.105s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8888936-95f8-43e5-98d9-7d93cd4fa229]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260]
Nov 10 16:21:38 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260] successful.
Nov 10 16:21:38 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.066s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c830bc-0b3e-4878-b727-73b6ad8a5efa]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb114512-a8f3-4828-837a-6a0ccc0b9d93]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:38 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:38 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:38 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.586s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] HCTL ('36', '-', '-', 0) found on session 14 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-ebcae27a-5be5-42bd-a300-e2e847c20cf2 req-acc4d9f3-0e42-45e4-934e-acef15c24152 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ebcae27a-5be5-42bd-a300-e2e847c20cf2 req-acc4d9f3-0e42-45e4-934e-acef15c24152 service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ebcae27a-5be5-42bd-a300-e2e847c20cf2 req-acc4d9f3-0e42-45e4-934e-acef15c24152 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ebcae27a-5be5-42bd-a300-e2e847c20cf2 req-acc4d9f3-0e42-45e4-934e-acef15c24152 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-ebcae27a-5be5-42bd-a300-e2e847c20cf2 req-acc4d9f3-0e42-45e4-934e-acef15c24152 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:39 user nova-compute[75102]: WARNING nova.compute.manager [req-ebcae27a-5be5-42bd-a300-e2e847c20cf2 req-acc4d9f3-0e42-45e4-934e-acef15c24152 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state active and task_state rescuing.
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.071s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0257513-3cba-44a9-b4aa-952b68949354]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Searching for a device in session 14 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMVPuJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405.part /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405.converted" returned: 0 in 1.364s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405.converted --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-b10c64b6-0a72-44a4-9771-9e5ee206af29 req-535cc3a7-4428-4dd4-8d64-11dbb7483098 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Updated VIF entry in instance network info cache for port 08be21b4-29e4-47eb-a6b9-6453851133d2. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-b10c64b6-0a72-44a4-9771-9e5ee206af29 req-535cc3a7-4428-4dd4-8d64-11dbb7483098 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Updating instance_info_cache with network_info: [{"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b10c64b6-0a72-44a4-9771-9e5ee206af29 req-535cc3a7-4428-4dd4-8d64-11dbb7483098 service nova] Releasing lock "refresh_cache-5690a54a-d70d-4342-8838-5ea22588c5ef" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ae29283d-2d3d-411e-8165-e932dd74dfd3 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 88.056s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405.converted --force-share --output=json" returned: 0 in 0.227s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "e3b6cfd187b984b776c5d8a6e86927a773cec405" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.889s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "e3b6cfd187b984b776c5d8a6e86927a773cec405" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "e3b6cfd187b984b776c5d8a6e86927a773cec405" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405 --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405,backing_fmt=raw /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405,backing_fmt=raw /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue" returned: 0 in 0.060s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "e3b6cfd187b984b776c5d8a6e86927a773cec405" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.objects.instance [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'migration_context' on Instance uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.objects.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<371a2928-c805-47e0-aeb8-e5140aac7b23> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Start _get_guest_xml network_info=[{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "vif_mac": "fa:16:3e:20:b9:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b9aefc7f-fda1-44c1-b718-2e8f90d5c2ae', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6e87894e-183d-41c0-84fa-d5ddc996f029', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHzKvIqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': '371a2928-c805-47e0-aeb8-e5140aac7b23', 'attached_at': '', 'detached_at': '', 'volume_id': '0c3a0a72-af1b-4b34-bdd7-127af133e488', 'serial': '0c3a0a72-af1b-4b34-bdd7-127af133e488'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.objects.instance [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'resources' on Instance uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.objects.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<371a2928-c805-47e0-aeb8-e5140aac7b23> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.objects.instance [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'numa_topology' on Instance uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.objects.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<371a2928-c805-47e0-aeb8-e5140aac7b23> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:39 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:21:39 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.objects.instance [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'vcpu_model' on Instance uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.objects.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<371a2928-c805-47e0-aeb8-e5140aac7b23> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:21:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHzKvIqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:21:39 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:21:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.694s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] <== connect_volume: return (1695ms) {'type': 'block', 'scsi_wwn': '26338336531633765', 'path': '/dev/sde'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338336531633765', 'path': '/dev/sde'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.158s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:21:40 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:21:40 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-598809847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-762086081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCYcmc6fbkVb87dY5vNaRKdJPEGkW/2zIEZbxcYW56VTIvJZFnE6PxiWcAsvDS1lc7Hspn+uCDjxoiD1E6lbtqupamzWdbjY1UQdTjVnbkbvuyi/ytsTEUONZgVQW/ong==',key_name='tempest-keypair-583205912',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:17:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23ed0272e95b41a6b623002f93b1511f',ramdisk_id='',reservation_id='r-wi7m0598',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-725654860',owner_user_name='tempest-ServerActionsV293TestJSON-725654860-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a50fb02c29f417d97115fdf45ffbcee',uuid=6458fc11-6612-4108-addd-ce61d935431e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converting VIF {"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:21:40 user nova-compute[75102]:   <uuid>6458fc11-6612-4108-addd-ce61d935431e</uuid>
Nov 10 16:21:40 user nova-compute[75102]:   <name>instance-00000008</name>
Nov 10 16:21:40 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:21:40 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:21:40 user nova-compute[75102]:   <metadata>
Nov 10 16:21:40 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:21:40 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:name>tempest-ServerActionsV293TestJSON-server-598809847</nova:name>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:21:38</nova:creationTime>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:21:40 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:21:40 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:owner>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:user uuid="0a50fb02c29f417d97115fdf45ffbcee">tempest-ServerActionsV293TestJSON-725654860-project-member</nova:user>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:project uuid="23ed0272e95b41a6b623002f93b1511f">tempest-ServerActionsV293TestJSON-725654860</nova:project>
Nov 10 16:21:40 user nova-compute[75102]:       </nova:owner>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:ports>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:port uuid="57d19842-a13a-4616-b2fd-9957fc90f7c7">
Nov 10 16:21:40 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 16:21:40 user nova-compute[75102]:         </nova:port>
Nov 10 16:21:40 user nova-compute[75102]:       </nova:ports>
Nov 10 16:21:40 user nova-compute[75102]:     </nova:instance>
Nov 10 16:21:40 user nova-compute[75102]:   </metadata>
Nov 10 16:21:40 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:21:40 user nova-compute[75102]:     <system>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="serial">6458fc11-6612-4108-addd-ce61d935431e</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="uuid">6458fc11-6612-4108-addd-ce61d935431e</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:21:40 user nova-compute[75102]:     </system>
Nov 10 16:21:40 user nova-compute[75102]:   </sysinfo>
Nov 10 16:21:40 user nova-compute[75102]:   <os>
Nov 10 16:21:40 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:21:40 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:21:40 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:21:40 user nova-compute[75102]:   </os>
Nov 10 16:21:40 user nova-compute[75102]:   <features>
Nov 10 16:21:40 user nova-compute[75102]:     <acpi/>
Nov 10 16:21:40 user nova-compute[75102]:     <apic/>
Nov 10 16:21:40 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:21:40 user nova-compute[75102]:   </features>
Nov 10 16:21:40 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:21:40 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:21:40 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:21:40 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:21:40 user nova-compute[75102]:   </clock>
Nov 10 16:21:40 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:21:40 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:21:40 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:21:40 user nova-compute[75102]:   </cpu>
Nov 10 16:21:40 user nova-compute[75102]:   <devices>
Nov 10 16:21:40 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:21:40 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:21:40 user nova-compute[75102]:       <source dev="/dev/sde"/>
Nov 10 16:21:40 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:21:40 user nova-compute[75102]:       <serial>aefc9e87-7a41-45fe-97a7-113f4a673159</serial>
Nov 10 16:21:40 user nova-compute[75102]:     </disk>
Nov 10 16:21:40 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:21:40 user nova-compute[75102]:       <mac address="fa:16:3e:5e:42:60"/>
Nov 10 16:21:40 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:21:40 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:21:40 user nova-compute[75102]:       <target dev="tap57d19842-a1"/>
Nov 10 16:21:40 user nova-compute[75102]:     </interface>
Nov 10 16:21:40 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:21:40 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/6458fc11-6612-4108-addd-ce61d935431e/console.log" append="off"/>
Nov 10 16:21:40 user nova-compute[75102]:     </serial>
Nov 10 16:21:40 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:21:40 user nova-compute[75102]:     <video>
Nov 10 16:21:40 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:21:40 user nova-compute[75102]:     </video>
Nov 10 16:21:40 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:21:40 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:21:40 user nova-compute[75102]:     </rng>
Nov 10 16:21:40 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:21:40 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:21:40 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:21:40 user nova-compute[75102]:     </memballoon>
Nov 10 16:21:40 user nova-compute[75102]:   </devices>
Nov 10 16:21:40 user nova-compute[75102]: </domain>
Nov 10 16:21:40 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-598809847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-762086081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCYcmc6fbkVb87dY5vNaRKdJPEGkW/2zIEZbxcYW56VTIvJZFnE6PxiWcAsvDS1lc7Hspn+uCDjxoiD1E6lbtqupamzWdbjY1UQdTjVnbkbvuyi/ytsTEUONZgVQW/ong==',key_name='tempest-keypair-583205912',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:17:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='23ed0272e95b41a6b623002f93b1511f',ramdisk_id='',reservation_id='r-wi7m0598',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-725654860',owner_user_name='tempest-ServerActionsV293TestJSON-725654860-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:21:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a50fb02c29f417d97115fdf45ffbcee',uuid=6458fc11-6612-4108-addd-ce61d935431e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converting VIF {"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_vif [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260" returned: 0 in 0.036s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[51870f91-4ec6-42c0-8f0a-c6dfa599ede7]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = EHzKvIqm\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 16:21:40 user nova-compute[75102]: node.name = iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:21:40 user nova-compute[75102]: node.tpgt = -1
Nov 10 16:21:40 user nova-compute[75102]: node.startup = automatic
Nov 10 16:21:40 user nova-compute[75102]: node.leading_login = No
Nov 10 16:21:40 user nova-compute[75102]: iface.iscsi_ifacename = default
Nov 10 16:21:40 user nova-compute[75102]: iface.net_ifacename = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.ipaddress = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.prefix_len = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.hwaddress = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.transport_name = tcp
Nov 10 16:21:40 user nova-compute[75102]: iface.initiatorname = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.state = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.vlan_id = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.vlan_priority = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.vlan_state = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.iface_num = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.mtu = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.port = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.bootproto = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.subnet_mask = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.gateway = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.dhcp_alt_client_id = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.dhcp_dns = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.dhcp_learn_iqn = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.dhcp_vendor_id_state = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.dhcp_vendor_id = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.dhcp_slp_da = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.fragmentation = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.gratuitous_arp = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.incoming_forwarding = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.tos_state = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.tos = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.ttl = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.delayed_ack = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.tcp_nagle = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.tcp_wsf_state = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.tcp_wsf = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.tcp_timer_scale = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.tcp_timestamp = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.redirect = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.def_task_mgmt_timeout = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.header_digest = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.data_digest = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.immediate_data = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.initial_r2t = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.data_seq_inorder = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.data_pdu_inorder = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.erl = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.max_receive_data_len = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.first_burst_len = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.max_outstanding_r2t = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.max_burst_len = 0
Nov 10 16:21:40 user nova-compute[75102]: iface.chap_auth = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.bidi_chap = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.strict_login_compliance = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.discovery_auth = <empty>
Nov 10 16:21:40 user nova-compute[75102]: iface.discovery_logout = <empty>
Nov 10 16:21:40 user nova-compute[75102]: node.discovery_address = <empty>
Nov 10 16:21:40 user nova-compute[75102]: node.discovery_port = 0
Nov 10 16:21:40 user nova-compute[75102]: node.discovery_type = static
Nov 10 16:21:40 user nova-compute[75102]: node.session.initial_cmdsn = 0
Nov 10 16:21:40 user nova-compute[75102]: node.session.initial_login_retry_max = 8
Nov 10 16:21:40 user nova-compute[75102]: node.session.xmit_thread_priority = -20
Nov 10 16:21:40 user nova-compute[75102]: node.session.cmds_max = 128
Nov 10 16:21:40 user nova-compute[75102]: node.session.queue_depth = 32
Nov 10 16:21:40 user nova-compute[75102]: node.session.nr_sessions = 1
Nov 10 16:21:40 user nova-compute[75102]: node.session.auth.authmethod = CHAP
Nov 10 16:21:40 user nova-compute[75102]: node.session.auth.username = EHzKvIqm
Nov 10 16:21:40 user nova-compute[75102]: node.session.auth.password = ***
Nov 10 16:21:40 user nova-compute[75102]: node.session.auth.username_in = <empty>
Nov 10 16:21:40 user nova-compute[75102]: node.session.auth.password_in = <empty>
Nov 10 16:21:40 user nova-compute[75102]: node.session.auth.chap_algs = MD5
Nov 10 16:21:40 user nova-compute[75102]: node.session.timeo.replacement_timeout = 120
Nov 10 16:21:40 user nova-compute[75102]: node.session.err_timeo.abort_timeout = 15
Nov 10 16:21:40 user nova-compute[75102]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 16:21:40 user nova-compute[75102]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 16:21:40 user nova-compute[75102]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.FastAbort = Yes
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.InitialR2T = No
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.ImmediateData = Yes
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.MaxConnections = 1
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 16:21:40 user nova-compute[75102]: node.session.iscsi.ERL = 0
Nov 10 16:21:40 user nova-compute[75102]: node.session.scan = manual
Nov 10 16:21:40 user nova-compute[75102]: node.session.reopen_max = 0
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].address = 172.16.0.220
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].port = 3260
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].startup = manual
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].tcp.window_size = 524288
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].tcp.type_of_service = 0
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].timeo.logout_timeout = 15
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].timeo.login_timeout = 15
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].timeo.auth_timeout = 45
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].iscsi.DataDigest = None
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].iscsi.IFMarker = No
Nov 10 16:21:40 user nova-compute[75102]: node.conn[0].iscsi.OFMarker = No
Nov 10 16:21:40 user nova-compute[75102]: # END RECORD
Nov 10 16:21:40 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.compute.manager [req-50d6effc-8ef1-4b01-8baa-ab726a9ca6a3 req-1eafc590-2309-463f-96a9-afbe55cc35a8 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received event network-vif-plugged-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-50d6effc-8ef1-4b01-8baa-ab726a9ca6a3 req-1eafc590-2309-463f-96a9-afbe55cc35a8 service nova] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-50d6effc-8ef1-4b01-8baa-ab726a9ca6a3 req-1eafc590-2309-463f-96a9-afbe55cc35a8 service nova] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-50d6effc-8ef1-4b01-8baa-ab726a9ca6a3 req-1eafc590-2309-463f-96a9-afbe55cc35a8 service nova] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.compute.manager [req-50d6effc-8ef1-4b01-8baa-ab726a9ca6a3 req-1eafc590-2309-463f-96a9-afbe55cc35a8 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] No waiting events found dispatching network-vif-plugged-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:40 user nova-compute[75102]: WARNING nova.compute.manager [req-50d6effc-8ef1-4b01-8baa-ab726a9ca6a3 req-1eafc590-2309-463f-96a9-afbe55cc35a8 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received unexpected event network-vif-plugged-08be21b4-29e4-47eb-a6b9-6453851133d2 for instance with vm_state building and task_state spawning.
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9c11e8b0-7b51-5656-a765-df942153cadc', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e31ad47-f2ba-4a34-ac11-5c9e179e3276]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57d19842-a1, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57d19842-a1, col_values=(('qos', UUID('8ed19630-882a-40c8-850e-8de2c93eb62e')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57d19842-a1, col_values=(('external_ids', {'iface-id': '57d19842-a13a-4616-b2fd-9957fc90f7c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:42:60', 'vm-uuid': '6458fc11-6612-4108-addd-ce61d935431e'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[411fe8ee-2039-45d0-9d0c-d72564a02a6f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHzKvIqm {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: INFO os_vif [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1')
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EHzKvIqm" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[30d95d88-40a4-483b-8a9c-5146cfde8a9a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EHzKvIqm'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[922b9b3e-acbd-42fa-a921-a507305e4fef]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad2024e2-4905-46e0-b524-f9f8a48a46f3]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:40 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:40 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:40 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.257s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] HCTL ('33', '0', '0', 0) found on session 7 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] No VIF found with MAC fa:16:3e:5e:42:60, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a206497b-71df-4635-a9a4-65a6ec4e2952]: (4, ('0 0 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching for a device in session 7 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHzKvIqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.294s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] <== connect_volume: return (452ms) {'type': 'block', 'scsi_wwn': '23335656463346362', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335656463346362', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-736491098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-736491098',id=10,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:20:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-v0xb7v47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:20:09Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=371a2928-c805-47e0-aeb8-e5140aac7b23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "vif_mac": "fa:16:3e:20:b9:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "vif_mac": "fa:16:3e:20:b9:c7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:b9:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e334149-8bda-4d77-a44b-296a7ecf7a7d,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e334149-8b') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.objects.instance [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'pci_devices' on Instance uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.objects.base [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<371a2928-c805-47e0-aeb8-e5140aac7b23> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:21:40 user nova-compute[75102]:   <uuid>371a2928-c805-47e0-aeb8-e5140aac7b23</uuid>
Nov 10 16:21:40 user nova-compute[75102]:   <name>instance-0000000a</name>
Nov 10 16:21:40 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:21:40 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:21:40 user nova-compute[75102]:   <metadata>
Nov 10 16:21:40 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:21:40 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-736491098</nova:name>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:21:39</nova:creationTime>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:21:40 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:21:40 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:owner>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:user uuid="3149d0620bf64829aa4eec99a2cddee5">tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member</nova:user>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:project uuid="c0e926f56f914e7488a50f5bb78a33cd">tempest-ServerBootFromVolumeStableRescueTest-918868864</nova:project>
Nov 10 16:21:40 user nova-compute[75102]:       </nova:owner>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:21:40 user nova-compute[75102]:       <nova:ports>
Nov 10 16:21:40 user nova-compute[75102]:         <nova:port uuid="8e334149-8bda-4d77-a44b-296a7ecf7a7d">
Nov 10 16:21:40 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 16:21:40 user nova-compute[75102]:         </nova:port>
Nov 10 16:21:40 user nova-compute[75102]:       </nova:ports>
Nov 10 16:21:40 user nova-compute[75102]:     </nova:instance>
Nov 10 16:21:40 user nova-compute[75102]:   </metadata>
Nov 10 16:21:40 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:21:40 user nova-compute[75102]:     <system>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="serial">371a2928-c805-47e0-aeb8-e5140aac7b23</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="uuid">371a2928-c805-47e0-aeb8-e5140aac7b23</entry>
Nov 10 16:21:40 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:21:40 user nova-compute[75102]:     </system>
Nov 10 16:21:40 user nova-compute[75102]:   </sysinfo>
Nov 10 16:21:40 user nova-compute[75102]:   <os>
Nov 10 16:21:40 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:21:40 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:21:40 user nova-compute[75102]:   </os>
Nov 10 16:21:40 user nova-compute[75102]:   <features>
Nov 10 16:21:40 user nova-compute[75102]:     <acpi/>
Nov 10 16:21:40 user nova-compute[75102]:     <apic/>
Nov 10 16:21:40 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:21:40 user nova-compute[75102]:   </features>
Nov 10 16:21:40 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:21:40 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:21:40 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:21:40 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:21:40 user nova-compute[75102]:   </clock>
Nov 10 16:21:40 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:21:40 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:21:40 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:21:40 user nova-compute[75102]:   </cpu>
Nov 10 16:21:40 user nova-compute[75102]:   <devices>
Nov 10 16:21:40 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:21:40 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:21:40 user nova-compute[75102]:       <source dev="/dev/sdb"/>
Nov 10 16:21:40 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:21:40 user nova-compute[75102]:       <serial>0c3a0a72-af1b-4b34-bdd7-127af133e488</serial>
Nov 10 16:21:40 user nova-compute[75102]:     </disk>
Nov 10 16:21:40 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:21:40 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:21:40 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue"/>
Nov 10 16:21:40 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:21:40 user nova-compute[75102]:       <boot order="1"/>
Nov 10 16:21:40 user nova-compute[75102]:     </disk>
Nov 10 16:21:40 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:21:40 user nova-compute[75102]:       <mac address="fa:16:3e:20:b9:c7"/>
Nov 10 16:21:40 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:21:40 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:21:40 user nova-compute[75102]:       <target dev="tap8e334149-8b"/>
Nov 10 16:21:40 user nova-compute[75102]:     </interface>
Nov 10 16:21:40 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:21:40 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/console.log" append="off"/>
Nov 10 16:21:40 user nova-compute[75102]:     </serial>
Nov 10 16:21:40 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:21:40 user nova-compute[75102]:     <video>
Nov 10 16:21:40 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:21:40 user nova-compute[75102]:     </video>
Nov 10 16:21:40 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:21:40 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:21:40 user nova-compute[75102]:     </rng>
Nov 10 16:21:40 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:21:40 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:21:40 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:21:40 user nova-compute[75102]:     </memballoon>
Nov 10 16:21:40 user nova-compute[75102]:   </devices>
Nov 10 16:21:40 user nova-compute[75102]: </domain>
Nov 10 16:21:40 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:21:40 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Instance destroyed successfully.
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No VIF found with MAC fa:16:3e:20:b9:c7, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.compute.manager [req-73c0f67e-539e-43e0-97c9-d7e29b7ee64e req-28c5a81d-27b3-4bf2-8029-9cdeae2c226f service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received event network-vif-plugged-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-73c0f67e-539e-43e0-97c9-d7e29b7ee64e req-28c5a81d-27b3-4bf2-8029-9cdeae2c226f service nova] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-73c0f67e-539e-43e0-97c9-d7e29b7ee64e req-28c5a81d-27b3-4bf2-8029-9cdeae2c226f service nova] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-73c0f67e-539e-43e0-97c9-d7e29b7ee64e req-28c5a81d-27b3-4bf2-8029-9cdeae2c226f service nova] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.compute.manager [req-73c0f67e-539e-43e0-97c9-d7e29b7ee64e req-28c5a81d-27b3-4bf2-8029-9cdeae2c226f service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] No waiting events found dispatching network-vif-plugged-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:42 user nova-compute[75102]: WARNING nova.compute.manager [req-73c0f67e-539e-43e0-97c9-d7e29b7ee64e req-28c5a81d-27b3-4bf2-8029-9cdeae2c226f service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received unexpected event network-vif-plugged-08be21b4-29e4-47eb-a6b9-6453851133d2 for instance with vm_state building and task_state spawning.
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:21:42 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Instance spawned successfully.
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Stashing vm_state: active {{(pid=75102) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 16:21:42 user nova-compute[75102]: INFO nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Took 8.60 seconds to spawn the instance on the hypervisor.
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:42 user nova-compute[75102]: INFO nova.compute.manager [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Took 9.48 seconds to build instance.
Nov 10 16:21:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2113972-3ceb-4926-9afe-936ec091480d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.601s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:21:42 user nova-compute[75102]: INFO nova.compute.claims [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Claim successful on node user
Nov 10 16:21:42 user nova-compute[75102]: INFO nova.compute.resource_tracker [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating resource usage from migration 80853650-20a2-4068-911f-57e0a491c114
Nov 10 16:21:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-8200aa3f-2a28-40a2-8c5b-e04ad2dfab5b req-b5598b40-f9dc-4416-88bd-61922216bccf service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8200aa3f-2a28-40a2-8c5b-e04ad2dfab5b req-b5598b40-f9dc-4416-88bd-61922216bccf service nova] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8200aa3f-2a28-40a2-8c5b-e04ad2dfab5b req-b5598b40-f9dc-4416-88bd-61922216bccf service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8200aa3f-2a28-40a2-8c5b-e04ad2dfab5b req-b5598b40-f9dc-4416-88bd-61922216bccf service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-8200aa3f-2a28-40a2-8c5b-e04ad2dfab5b req-b5598b40-f9dc-4416-88bd-61922216bccf service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] No waiting events found dispatching network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:43 user nova-compute[75102]: WARNING nova.compute.manager [req-8200aa3f-2a28-40a2-8c5b-e04ad2dfab5b req-b5598b40-f9dc-4416-88bd-61922216bccf service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received unexpected event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.639s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:43 user nova-compute[75102]: INFO nova.compute.manager [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Migrating
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:21:43 user nova-compute[75102]: INFO nova.compute.rpcapi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquired lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG nova.network.neutron [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG nova.network.neutron [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Releasing lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:21:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Starting migrate_disk_and_power_off {{(pid=75102) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-e9f058d6-28be-4fca-98d1-8250a2334ad5 req-d87e9e5e-ebf7-49dc-9f5a-361bb3c7a16c service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-unplugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e9f058d6-28be-4fca-98d1-8250a2334ad5 req-d87e9e5e-ebf7-49dc-9f5a-361bb3c7a16c service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e9f058d6-28be-4fca-98d1-8250a2334ad5 req-d87e9e5e-ebf7-49dc-9f5a-361bb3c7a16c service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e9f058d6-28be-4fca-98d1-8250a2334ad5 req-d87e9e5e-ebf7-49dc-9f5a-361bb3c7a16c service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-e9f058d6-28be-4fca-98d1-8250a2334ad5 req-d87e9e5e-ebf7-49dc-9f5a-361bb3c7a16c service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-unplugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:44 user nova-compute[75102]: WARNING nova.compute.manager [req-e9f058d6-28be-4fca-98d1-8250a2334ad5 req-d87e9e5e-ebf7-49dc-9f5a-361bb3c7a16c service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-unplugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state active and task_state resize_migrating.
Nov 10 16:21:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance destroyed successfully.
Nov 10 16:21:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1376797735',display_name='tempest-ServerActionsTestOtherB-server-1376797735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1376797735',id=3,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHr0jwe70jfLAKGRmlC9Z1xJ9zp5YI31PlNstF6fiupDKXJEjbBPAkoJ7zXlYnnaeafbpydLq7gUD5yOQPm6w6xcEQdooK67LWtISX7OzOkN1IUKn+FbDIXcoKGGroQQ==',key_name='tempest-keypair-1977714077',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7d5f31d051084698bce41a77bc9faa87',ramdisk_id='',reservation_id='r-gdlg319g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-792699016',owner_user_name='tempest-ServerActionsTestOtherB-792699016-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb6cbfdc7334af4a5e4cae046d2e6b1',uuid=731624eb-b0c0-42c1-80cf-2dd76932e92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884003894-network", "vif_mac": "fa:16:3e:f8:94:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converting VIF {"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884003894-network", "vif_mac": "fa:16:3e:f8:94:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG os_vif [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73a78287-ce, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ffd32767-d668-466e-9ce5-8ab50fe2c068) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:21:45 user nova-compute[75102]: INFO os_vif [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce')
Nov 10 16:21:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:21:45 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[88c170a3-7e55-4e88-8995-3feb3a43298e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:21:45 user nova-compute[75102]: No targets found.
Nov 10 16:21:45 user nova-compute[75102]: iSNS:
Nov 10 16:21:45 user nova-compute[75102]: No targets found.
Nov 10 16:21:45 user nova-compute[75102]: STATIC:
Nov 10 16:21:45 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da
Nov 10 16:21:45 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:21:45 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:21:45 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159
Nov 10 16:21:45 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:21:45 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:21:45 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:21:45 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:21:45 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:21:45 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788
Nov 10 16:21:45 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:21:45 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:21:45 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:21:45 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:21:45 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:21:45 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e
Nov 10 16:21:45 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:21:45 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:21:45 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22
Nov 10 16:21:45 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:21:45 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:21:45 user nova-compute[75102]: FIRMWARE:
Nov 10 16:21:45 user nova-compute[75102]: No targets found.
Nov 10 16:21:45 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:21:45 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:21:45 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff40cba1-0ac5-4f00-a374-63e670c57590]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbbf3ef7-870f-403e-b2bb-bd6a34ab85f9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:45 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:21:45 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:21:45 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7449c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] No waiting events found dispatching network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:45 user nova-compute[75102]: WARNING nova.compute.manager [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received unexpected event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 16:21:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:45 user nova-compute[75102]: WARNING nova.compute.manager [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state active and task_state rescuing.
Nov 10 16:21:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:45 user nova-compute[75102]: WARNING nova.compute.manager [req-8aa0818c-df27-4e31-9cd1-2b21bbe388b0 req-e3251cea-0eac-4552-9722-bb56890bc01b service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state active and task_state rescuing.
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.072s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[470fe820-72d5-42f1-8042-45083f862fe2]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f97263c2-4559-40c2-9490-b37222801325]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a979a323-5cb6-49d4-92af-83eed6c53f8b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.084s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a2f2dd-f8fb-4c30-824e-375d276c7cde]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[10baeeb1-2050-4f81-af5d-4d05820c778c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[98fbe2d4-6398-407e-bb7a-30b18a45ff6a]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]
Nov 10 16:21:45 user nova-compute[75102]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.
Nov 10 16:21:45 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb51a42d-8101-4793-8f4d-51a71f1d2175]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.548s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] <== disconnect_volume: return (550ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a_resize/disk /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:21:46 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance spawned successfully.
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-be25a578-23b6-46f2-bc91-4fc42e3c315f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75102) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c1d2ac76-e643-4b26-a8ee-9cea73ffec07 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.111s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "cp -r /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a_resize/disk /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk" returned: 0 in 0.562s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a_resize/disk.info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk.info {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "cp -r /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a_resize/disk.info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk.info" returned: 0 in 0.045s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.compute.manager [req-6f9d3b84-2223-4248-b346-d42fb52c6c06 req-28d38ab7-ee06-43d6-a015-f022768c9c18 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6f9d3b84-2223-4248-b346-d42fb52c6c06 req-28d38ab7-ee06-43d6-a015-f022768c9c18 service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6f9d3b84-2223-4248-b346-d42fb52c6c06 req-28d38ab7-ee06-43d6-a015-f022768c9c18 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6f9d3b84-2223-4248-b346-d42fb52c6c06 req-28d38ab7-ee06-43d6-a015-f022768c9c18 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:46 user nova-compute[75102]: DEBUG nova.compute.manager [req-6f9d3b84-2223-4248-b346-d42fb52c6c06 req-28d38ab7-ee06-43d6-a015-f022768c9c18 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:21:46 user nova-compute[75102]: WARNING nova.compute.manager [req-6f9d3b84-2223-4248-b346-d42fb52c6c06 req-28d38ab7-ee06-43d6-a015-f022768c9c18 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state active and task_state resize_migrating.
Nov 10 16:21:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:48 user nova-compute[75102]: DEBUG nova.network.neutron [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Port 73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 binding to destination host user is already ACTIVE {{(pid=75102) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 16:21:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:21:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquired lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:21:48 user nova-compute[75102]: DEBUG nova.network.neutron [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:21:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG nova.network.neutron [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Releasing lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG os_brick.utils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fcbd0c-c395-4f8d-b194-2054bedcff82]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f376506-346c-487e-ad54-ee0df449ec6b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[02038f42-286b-467f-8a67-00242e9f44b3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d065a5-dbda-43c9-8453-bf37d37a51f7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:21:49 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:21:49 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f293e24-ab44-469e-a5f9-927908e8aba8]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG os_brick.utils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] <== get_connector_properties: return (173ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:21:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:51 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:51 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:21:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:21:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:21:51 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updating instance_info_cache with network_info: [{"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-ab373f84-9ba6-4336-bca7-602464b61fb3" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.283s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json" returned: 0 in 0.272s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue --force-share --output=json" returned: 0 in 0.221s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue --force-share --output=json" returned: 0 in 0.245s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdg (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdh (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:21:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdc) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:21:56 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:21:56 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8137MB free_disk=25.50942611694336GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Applying migration context for instance 731624eb-b0c0-42c1-80cf-2dd76932e92a as it has an incoming, in-progress migration 80853650-20a2-4068-911f-57e0a491c114. Migration status is post-migrating {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 16:21:56 user nova-compute[75102]: INFO nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating resource usage from migration 80853650-20a2-4068-911f-57e0a491c114
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ab373f84-9ba6-4336-bca7-602464b61fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6458fc11-6612-4108-addd-ce61d935431e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 2c40f2a3-dbfb-497d-8ec3-df38105cad20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a8562537-34e2-45eb-835c-a4dd59e3af7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 5690a54a-d70d-4342-8838-5ea22588c5ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Migration 80853650-20a2-4068-911f-57e0a491c114 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.891s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 16:21:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 16:21:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:21:59 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:21:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:22:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-c0ad857e-5d12-4df9-9907-6bc60d3332d0 req-6a41f566-d64d-4ca8-b0bb-4fc7d12da743 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received event network-changed-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-c0ad857e-5d12-4df9-9907-6bc60d3332d0 req-6a41f566-d64d-4ca8-b0bb-4fc7d12da743 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Refreshing instance network info cache due to event network-changed-d798edb0-43db-4e57-a080-2ea4db4bd5a3. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:22:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c0ad857e-5d12-4df9-9907-6bc60d3332d0 req-6a41f566-d64d-4ca8-b0bb-4fc7d12da743 service nova] Acquiring lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:22:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c0ad857e-5d12-4df9-9907-6bc60d3332d0 req-6a41f566-d64d-4ca8-b0bb-4fc7d12da743 service nova] Acquired lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:22:09 user nova-compute[75102]: DEBUG nova.network.neutron [req-c0ad857e-5d12-4df9-9907-6bc60d3332d0 req-6a41f566-d64d-4ca8-b0bb-4fc7d12da743 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Refreshing network info cache for port d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:22:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-c0ad857e-5d12-4df9-9907-6bc60d3332d0 req-6a41f566-d64d-4ca8-b0bb-4fc7d12da743 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Updated VIF entry in instance network info cache for port d798edb0-43db-4e57-a080-2ea4db4bd5a3. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:22:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-c0ad857e-5d12-4df9-9907-6bc60d3332d0 req-6a41f566-d64d-4ca8-b0bb-4fc7d12da743 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Updating instance_info_cache with network_info: [{"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:22:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c0ad857e-5d12-4df9-9907-6bc60d3332d0 req-6a41f566-d64d-4ca8-b0bb-4fc7d12da743 service nova] Releasing lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:22:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-df2b4d84-7bf5-4fdc-86a4-2b2102f7d090 req-7cbbff73-a89c-4c06-81b1-3b89050730c9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-changed-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-df2b4d84-7bf5-4fdc-86a4-2b2102f7d090 req-7cbbff73-a89c-4c06-81b1-3b89050730c9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing instance network info cache due to event network-changed-39c985ac-2f47-482e-8376-5a0d6531bbd4. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:22:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-df2b4d84-7bf5-4fdc-86a4-2b2102f7d090 req-7cbbff73-a89c-4c06-81b1-3b89050730c9 service nova] Acquiring lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:22:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-df2b4d84-7bf5-4fdc-86a4-2b2102f7d090 req-7cbbff73-a89c-4c06-81b1-3b89050730c9 service nova] Acquired lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:22:19 user nova-compute[75102]: DEBUG nova.network.neutron [req-df2b4d84-7bf5-4fdc-86a4-2b2102f7d090 req-7cbbff73-a89c-4c06-81b1-3b89050730c9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Refreshing network info cache for port 39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:22:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-df2b4d84-7bf5-4fdc-86a4-2b2102f7d090 req-7cbbff73-a89c-4c06-81b1-3b89050730c9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updated VIF entry in instance network info cache for port 39c985ac-2f47-482e-8376-5a0d6531bbd4. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:22:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-df2b4d84-7bf5-4fdc-86a4-2b2102f7d090 req-7cbbff73-a89c-4c06-81b1-3b89050730c9 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [{"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:22:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-df2b4d84-7bf5-4fdc-86a4-2b2102f7d090 req-7cbbff73-a89c-4c06-81b1-3b89050730c9 service nova] Releasing lock "refresh_cache-2c40f2a3-dbfb-497d-8ec3-df38105cad20" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:22 user nova-compute[75102]: INFO nova.compute.manager [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Terminating instance
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-8b34a0b6-8348-4fd9-8b19-3311b6a02482 req-c1bc5fb9-583a-4b60-9b64-56bebfb094bd service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8b34a0b6-8348-4fd9-8b19-3311b6a02482 req-c1bc5fb9-583a-4b60-9b64-56bebfb094bd service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8b34a0b6-8348-4fd9-8b19-3311b6a02482 req-c1bc5fb9-583a-4b60-9b64-56bebfb094bd service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8b34a0b6-8348-4fd9-8b19-3311b6a02482 req-c1bc5fb9-583a-4b60-9b64-56bebfb094bd service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-8b34a0b6-8348-4fd9-8b19-3311b6a02482 req-c1bc5fb9-583a-4b60-9b64-56bebfb094bd service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-unplugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-8b34a0b6-8348-4fd9-8b19-3311b6a02482 req-c1bc5fb9-583a-4b60-9b64-56bebfb094bd service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-5327ef8c-c30f-4314-96ac-d731e142c276 req-066b7115-5475-4d18-8f73-baed4b05401b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5327ef8c-c30f-4314-96ac-d731e142c276 req-066b7115-5475-4d18-8f73-baed4b05401b service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5327ef8c-c30f-4314-96ac-d731e142c276 req-066b7115-5475-4d18-8f73-baed4b05401b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5327ef8c-c30f-4314-96ac-d731e142c276 req-066b7115-5475-4d18-8f73-baed4b05401b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-5327ef8c-c30f-4314-96ac-d731e142c276 req-066b7115-5475-4d18-8f73-baed4b05401b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-unplugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-5327ef8c-c30f-4314-96ac-d731e142c276 req-066b7115-5475-4d18-8f73-baed4b05401b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-88529932-0bf6-4145-932d-2424a4c68710 req-26edc93b-cb49-4323-a1e7-db63ab84b5a3 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88529932-0bf6-4145-932d-2424a4c68710 req-26edc93b-cb49-4323-a1e7-db63ab84b5a3 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88529932-0bf6-4145-932d-2424a4c68710 req-26edc93b-cb49-4323-a1e7-db63ab84b5a3 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88529932-0bf6-4145-932d-2424a4c68710 req-26edc93b-cb49-4323-a1e7-db63ab84b5a3 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-88529932-0bf6-4145-932d-2424a4c68710 req-26edc93b-cb49-4323-a1e7-db63ab84b5a3 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-unplugged-ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-88529932-0bf6-4145-932d-2424a4c68710 req-26edc93b-cb49-4323-a1e7-db63ab84b5a3 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-ba625408-a772-4626-82a3-b411c917d6cd for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:22:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Instance destroyed successfully.
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.objects.instance [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lazy-loading 'resources' on Instance uuid 2c40f2a3-dbfb-497d-8ec3-df38105cad20 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "address": "fa:16:3e:44:64:d0", "network": {"id": "ba224a99-36e3-41e7-9680-2706ddbc2be9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-254849988-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap39c985ac-2f", "ovs_interfaceid": "39c985ac-2f47-482e-8376-5a0d6531bbd4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=39c985ac-2f47-482e-8376-5a0d6531bbd4,network=Network(ba224a99-36e3-41e7-9680-2706ddbc2be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c985ac-2f') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=39c985ac-2f47-482e-8376-5a0d6531bbd4,network=Network(ba224a99-36e3-41e7-9680-2706ddbc2be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c985ac-2f') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap39c985ac-2f, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=da07ec00-1d6f-4bed-a71a-448e5cd38d5c) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: INFO os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:64:d0,bridge_name='br-int',has_traffic_filtering=True,id=39c985ac-2f47-482e-8376-5a0d6531bbd4,network=Network(ba224a99-36e3-41e7-9680-2706ddbc2be9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap39c985ac-2f')
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:cd,bridge_name='br-int',has_traffic_filtering=True,id=3158e32f-b3dc-4bbf-878e-dcb004f642a3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3158e32f-b3') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:cd,bridge_name='br-int',has_traffic_filtering=True,id=3158e32f-b3dc-4bbf-878e-dcb004f642a3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3158e32f-b3') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3158e32f-b3, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=961d7f03-0bde-4b91-b8d7-4ba3c41c6e0b) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: INFO os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c5:a5:cd,bridge_name='br-int',has_traffic_filtering=True,id=3158e32f-b3dc-4bbf-878e-dcb004f642a3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap3158e32f-b3')
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=ba625408-a772-4626-82a3-b411c917d6cd,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba625408-a7') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=ba625408-a772-4626-82a3-b411c917d6cd,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba625408-a7') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapba625408-a7, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f44c8506-56d7-449e-a2ad-7229e4d39a15) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: INFO os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:cd:06,bridge_name='br-int',has_traffic_filtering=True,id=ba625408-a772-4626-82a3-b411c917d6cd,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapba625408-a7')
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b83d6e13-aa0f-4815-8b3e-91e003b2b136,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d6e13-aa') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b83d6e13-aa0f-4815-8b3e-91e003b2b136,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d6e13-aa') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb83d6e13-aa, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0e229339-a0b3-4e24-bd19-07bec2d3e5ff) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: INFO os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:14:b8,bridge_name='br-int',has_traffic_filtering=True,id=b83d6e13-aa0f-4815-8b3e-91e003b2b136,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb83d6e13-aa')
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=03e161ba-5708-40fa-96d1-895fbaf95ca3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e161ba-57') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=03e161ba-5708-40fa-96d1-895fbaf95ca3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e161ba-57') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap03e161ba-57, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=55f7f3d9-5154-4550-94ff-5685c1c2e2fc) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: INFO os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:45:9e,bridge_name='br-int',has_traffic_filtering=True,id=03e161ba-5708-40fa-96d1-895fbaf95ca3,network=Network(f84b8ea2-4342-4808-85bb-c7526740152a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap03e161ba-57')
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b4412faa-9961-4fa7-9993-76a00afbe6b6,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4412faa-99') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b4412faa-9961-4fa7-9993-76a00afbe6b6,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4412faa-99') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb4412faa-99, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a6327749-7592-4851-bc07-4a414ab4232c) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:24 user nova-compute[75102]: WARNING nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-3158e32f-b3dc-4bbf-878e-dcb004f642a3 for instance with vm_state active and task_state deleting.
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-unplugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:24 user nova-compute[75102]: WARNING nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-b83d6e13-aa0f-4815-8b3e-91e003b2b136 for instance with vm_state active and task_state deleting.
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-unplugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:24 user nova-compute[75102]: WARNING nova.compute.manager [req-8c04eea0-761d-4523-91fd-1c7d5082cec8 req-121405ea-dffd-4965-8532-1ba3cb67080a service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-03e161ba-5708-40fa-96d1-895fbaf95ca3 for instance with vm_state active and task_state deleting.
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:24 user nova-compute[75102]: INFO os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bb:b0:5a,bridge_name='br-int',has_traffic_filtering=True,id=b4412faa-9961-4fa7-9993-76a00afbe6b6,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb4412faa-99')
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:17:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1842012506',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1842012506',id=9,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBus9TQW/40DT3kT+l9rMcmFrka8ct1jSKXgd1FG/7qLW7JZgSARecnOPo4wK5ftHmaLsZRytkwYcGwwPRMGrf59NIotdX2Ey7StGauiBj/bLaNJ/e2RKD95FMzaEWd/sw==',key_name='tempest-keypair-1706657785',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:20:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3ce93c56e5e943789f4178c52523a81c',ramdisk_id='',reservation_id='r-xg20hmpr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-603901565',owner_user_name='tempest-TaggedBootDevicesTest-603901565-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:20:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7158e1b0077b4cdfaf14fe39a43fafa7',uuid=2c40f2a3-dbfb-497d-8ec3-df38105cad20,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converting VIF {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1c:e5,bridge_name='br-int',has_traffic_filtering=True,id=a0215f7d-3a99-4c69-af70-d886b84dcc36,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0215f7d-3a') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1c:e5,bridge_name='br-int',has_traffic_filtering=True,id=a0215f7d-3a99-4c69-af70-d886b84dcc36,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0215f7d-3a') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa0215f7d-3a, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1f4fe86b-8558-4ae7-87d2-2f254e6faee8) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:24 user nova-compute[75102]: INFO os_vif [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:1c:e5,bridge_name='br-int',has_traffic_filtering=True,id=a0215f7d-3a99-4c69-af70-d886b84dcc36,network=Network(7cbbfbd7-079b-461d-9a00-29eb442e86ab),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa0215f7d-3a')
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'VyLNpSdr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:22:24 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ce407f-07f9-49e5-bfaf-6739aa65edc1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:22:24 user nova-compute[75102]: No targets found.
Nov 10 16:22:24 user nova-compute[75102]: iSNS:
Nov 10 16:22:24 user nova-compute[75102]: No targets found.
Nov 10 16:22:24 user nova-compute[75102]: STATIC:
Nov 10 16:22:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da
Nov 10 16:22:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159
Nov 10 16:22:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:22:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:22:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e
Nov 10 16:22:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22
Nov 10 16:22:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:24 user nova-compute[75102]: FIRMWARE:
Nov 10 16:22:24 user nova-compute[75102]: No targets found.
Nov 10 16:22:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:22:24 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:22:24 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c30cc210-da58-439d-9f1d-7ab46abe68c8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:24 user nova-compute[75102]: WARNING nova.compute.manager [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-39c985ac-2f47-482e-8376-5a0d6531bbd4 for instance with vm_state active and task_state deleting.
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-unplugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:24 user nova-compute[75102]: WARNING nova.compute.manager [req-ee0ad813-f2f1-488d-ba2e-cd846cbd355e req-57af32e8-5943-42c7-b753-5f611b819622 service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-a0215f7d-3a99-4c69-af70-d886b84dcc36 for instance with vm_state active and task_state deleting.
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[74859528-8e1c-4857-9997-55adea3e6970]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:22:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:24 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:22:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7459fac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:22:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f874c99f-7942-4064-af7f-5e195ce4bc5b]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-ba625408-a772-4626-82a3-b411c917d6cd {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:25 user nova-compute[75102]: WARNING nova.compute.manager [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-ba625408-a772-4626-82a3-b411c917d6cd for instance with vm_state active and task_state deleting.
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-unplugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-unplugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-plugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] No waiting events found dispatching network-vif-plugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:25 user nova-compute[75102]: WARNING nova.compute.manager [req-0cd230d2-1208-46b9-983a-c292ae80f9cb req-52922739-84b5-471d-94a6-5b527432f60b service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received unexpected event network-vif-plugged-b4412faa-9961-4fa7-9993-76a00afbe6b6 for instance with vm_state active and task_state deleting.
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60b325e-d009-4c86-aa33-2f29e07096d3]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5335045d-7f1a-4423-ad67-a31359452998]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.042s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[497a0241-78c5-4a2c-adb2-647f46963f72]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[57677fce-83b0-4ac8-8752-0b1086b48dfc]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[211de858-efc2-4357-8fd2-3e828b3411d9]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22, portal: 172.16.0.220,3260]
Nov 10 16:22:25 user nova-compute[75102]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22, portal: 172.16.0.220,3260] successful.
Nov 10 16:22:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2a40ac1e-af7b-4a08-99b8-448c9a463f22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e67d706-caaa-4f55-8fdb-85ef6937487d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] <== disconnect_volume: return (383ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wqyNrRIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:22:25 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0264c0-9b9b-42a9-b41b-d968c9fda26f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:22:25 user nova-compute[75102]: No targets found.
Nov 10 16:22:25 user nova-compute[75102]: iSNS:
Nov 10 16:22:25 user nova-compute[75102]: No targets found.
Nov 10 16:22:25 user nova-compute[75102]: STATIC:
Nov 10 16:22:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da
Nov 10 16:22:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159
Nov 10 16:22:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:22:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:22:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e
Nov 10 16:22:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:25 user nova-compute[75102]: FIRMWARE:
Nov 10 16:22:25 user nova-compute[75102]: No targets found.
Nov 10 16:22:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:22:25 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:22:25 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f95686-b282-48a2-8271-6843b38b5689]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.058s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4202e8e5-035e-4325-b817-4060f3140db4]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:22:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da (non-flash)
Nov 10 16:22:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f84173130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da'): ({'sdg'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Removing single pathed devices sdg {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9f5957-11bb-4978-b516-ddfd8e6b6545]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1ca49-6078-4c89-9737-b5b6a16e8b9c]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Flushing IO for device /dev/sdg {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c12dd0-c50d-48e4-ae78-4f95cb94783d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.060s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2aa71b4-ce1b-48bc-b0f2-d3d114d9a29c]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] SCSI volumes sdg have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3817a6-016a-4160-ad5a-37caecd9739c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecbdc48-2929-4014-8dd1-860615d9f5f9]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da, portal: 172.16.0.220,3260]
Nov 10 16:22:25 user nova-compute[75102]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da, portal: 172.16.0.220,3260] successful.
Nov 10 16:22:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3e4bc73d-8513-446f-ae00-b5d4b697d1da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7a010bb-d6f1-4593-92ed-89b2b40ef87b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] <== disconnect_volume: return (408ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZJtGvrXj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:22:25 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3191f1-9d51-4c34-92af-bb52cccb2676]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:22:25 user nova-compute[75102]: No targets found.
Nov 10 16:22:25 user nova-compute[75102]: iSNS:
Nov 10 16:22:25 user nova-compute[75102]: No targets found.
Nov 10 16:22:25 user nova-compute[75102]: STATIC:
Nov 10 16:22:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159
Nov 10 16:22:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:22:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:22:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e
Nov 10 16:22:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:22:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:22:25 user nova-compute[75102]: FIRMWARE:
Nov 10 16:22:25 user nova-compute[75102]: No targets found.
Nov 10 16:22:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:22:25 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:22:25 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf7bb8f-4af6-4f9e-97e3-68ac8c6a0aa6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[305ca43e-aed9-477b-abfc-9e41f8913349]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:25 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f84173130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e'): ({'sdh'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Removing single pathed devices sdh {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db1aab0-b7dc-483f-bb9c-45d6b3470c7e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6636fd36-6b2b-45be-9426-789414a809be]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Flushing IO for device /dev/sdh {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3f7319-8ad8-4b9c-94b4-422b4f420853]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.059s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a88f1a-d576-4c5b-bfde-83a5e689d353]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] SCSI volumes sdh have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4315a375-7f27-49b5-a796-57a73b37c203]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e82c5a-8762-44f3-ba23-08f57af3ecc8]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e, portal: 172.16.0.220,3260]
Nov 10 16:22:26 user nova-compute[75102]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e, portal: 172.16.0.220,3260] successful.
Nov 10 16:22:26 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:5f540661-66a9-48fb-9f99-56e935034a1e -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc58e462-793f-4d54-a1d2-4a674111d52d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] <== disconnect_volume: return (378ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:22:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Deleting instance files /opt/stack/data/nova/instances/2c40f2a3-dbfb-497d-8ec3-df38105cad20_del
Nov 10 16:22:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Deletion of /opt/stack/data/nova/instances/2c40f2a3-dbfb-497d-8ec3-df38105cad20_del complete
Nov 10 16:22:26 user nova-compute[75102]: INFO nova.compute.manager [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Took 3.88 seconds to destroy the instance on the hypervisor.
Nov 10 16:22:26 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:22:26 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:22:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-581cd485-b84a-4a09-9452-ad6dfda87db5 req-946bce83-71b9-408d-862a-cf1af1c2f65d service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-deleted-39c985ac-2f47-482e-8376-5a0d6531bbd4 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:29 user nova-compute[75102]: INFO nova.compute.manager [req-581cd485-b84a-4a09-9452-ad6dfda87db5 req-946bce83-71b9-408d-862a-cf1af1c2f65d service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Neutron deleted interface 39c985ac-2f47-482e-8376-5a0d6531bbd4; detaching it from the instance and deleting it from the info cache
Nov 10 16:22:29 user nova-compute[75102]: DEBUG nova.network.neutron [req-581cd485-b84a-4a09-9452-ad6dfda87db5 req-946bce83-71b9-408d-862a-cf1af1c2f65d service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [{"id": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "address": "fa:16:3e:c5:a5:cd", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.211", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3158e32f-b3", "ovs_interfaceid": "3158e32f-b3dc-4bbf-878e-dcb004f642a3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "ba625408-a772-4626-82a3-b411c917d6cd", "address": "fa:16:3e:17:cd:06", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.32", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapba625408-a7", "ovs_interfaceid": "ba625408-a772-4626-82a3-b411c917d6cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "address": "fa:16:3e:98:14:b8", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb83d6e13-aa", "ovs_interfaceid": "b83d6e13-aa0f-4815-8b3e-91e003b2b136", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "address": "fa:16:3e:d9:45:9e", "network": {"id": "f84b8ea2-4342-4808-85bb-c7526740152a", "bridge": "br-int", "label": "tempest-device-tagging-net1-1813552892", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.36", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap03e161ba-57", "ovs_interfaceid": "03e161ba-5708-40fa-96d1-895fbaf95ca3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "address": "fa:16:3e:bb:b0:5a", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb4412faa-99", "ovs_interfaceid": "b4412faa-9961-4fa7-9993-76a00afbe6b6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "address": "fa:16:3e:cd:1c:e5", "network": {"id": "7cbbfbd7-079b-461d-9a00-29eb442e86ab", "bridge": "br-int", "label": "tempest-device-tagging-net2-1789106427", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "3ce93c56e5e943789f4178c52523a81c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa0215f7d-3a", "ovs_interfaceid": "a0215f7d-3a99-4c69-af70-d886b84dcc36", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:22:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-581cd485-b84a-4a09-9452-ad6dfda87db5 req-946bce83-71b9-408d-862a-cf1af1c2f65d service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Detach interface failed, port_id=39c985ac-2f47-482e-8376-5a0d6531bbd4, reason: Instance 2c40f2a3-dbfb-497d-8ec3-df38105cad20 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:22:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:30 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:22:30 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Took 4.51 seconds to deallocate network for instance.
Nov 10 16:22:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-c003ebd0-b1d9-4848-8d1c-babd4756f188 req-ad74f196-78a7-452d-9e43-e087bf10392c service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-deleted-b83d6e13-aa0f-4815-8b3e-91e003b2b136 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-c003ebd0-b1d9-4848-8d1c-babd4756f188 req-ad74f196-78a7-452d-9e43-e087bf10392c service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-deleted-03e161ba-5708-40fa-96d1-895fbaf95ca3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-c003ebd0-b1d9-4848-8d1c-babd4756f188 req-ad74f196-78a7-452d-9e43-e087bf10392c service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-deleted-b4412faa-9961-4fa7-9993-76a00afbe6b6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-c003ebd0-b1d9-4848-8d1c-babd4756f188 req-ad74f196-78a7-452d-9e43-e087bf10392c service nova] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Received event network-vif-deleted-a0215f7d-3a99-4c69-af70-d886b84dcc36 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:37 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:22:38 user nova-compute[75102]: INFO nova.compute.claims [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Claim successful on node user
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.593s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:22:38 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.policy [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1471fdc4198b43adbdadb762d584acc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ce78721e684c9581fba3a8412b6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:22:38 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Creating image(s)
Nov 10 16:22:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "/opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "/opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.170s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.191s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk 1073741824" returned: 0 in 0.069s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Cannot resize image /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Ensure instance console log exists: /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Successfully created port: c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Successfully updated port: c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquired lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG nova.compute.manager [req-721bd21f-22ba-43e9-b3be-e6803e2f6959 req-f77d3915-42dd-451c-a55c-395f2cb0916e service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received event network-changed-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG nova.compute.manager [req-721bd21f-22ba-43e9-b3be-e6803e2f6959 req-f77d3915-42dd-451c-a55c-395f2cb0916e service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Refreshing instance network info cache due to event network-changed-c0200ac3-e977-497b-958b-c0abe0030166. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-721bd21f-22ba-43e9-b3be-e6803e2f6959 req-f77d3915-42dd-451c-a55c-395f2cb0916e service nova] Acquiring lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:40 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Starting finish_migration {{(pid=75102) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance directory exists: not creating {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 16:22:41 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Creating image(s)
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Updating instance_info_cache with network_info: [{"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.201s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Checking if we can resize image /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk. size=21474836480 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Releasing lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Instance network_info: |[{"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-721bd21f-22ba-43e9-b3be-e6803e2f6959 req-f77d3915-42dd-451c-a55c-395f2cb0916e service nova] Acquired lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.network.neutron [req-721bd21f-22ba-43e9-b3be-e6803e2f6959 req-f77d3915-42dd-451c-a55c-395f2cb0916e service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Refreshing network info cache for port c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Start _get_guest_xml network_info=[{"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:22:41 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:22:41 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1142194967',display_name='tempest-VolumesAdminNegativeTest-server-1142194967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1142194967',id=13,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJA7d6FjjU6j3Dfak75FjKZ4vc5bedosW1fEUbjJWHclvqgSiXjN/TfPuTpJgeg63aC+6yh1VVfwB/MFmn0Ge9/hUfzW1S4+wNEEFvElz9Abv04+WceiCrW6ikP/7Xlqw==',key_name='tempest-keypair-385827681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6ce78721e684c9581fba3a8412b6ac5',ramdisk_id='',reservation_id='r-2xlooi7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1261870727',owner_user_name='tempest-VolumesAdminNegativeTest-1261870727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1471fdc4198b43adbdadb762d584acc6',uuid=e4c81c8e-88f5-4789-8f0a-034965ec6f5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converting VIF {"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:7d:ec,bridge_name='br-int',has_traffic_filtering=True,id=c0200ac3-e977-497b-958b-c0abe0030166,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0200ac3-e9') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.objects.instance [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lazy-loading 'pci_devices' on Instance uuid e4c81c8e-88f5-4789-8f0a-034965ec6f5e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:22:41 user nova-compute[75102]:   <uuid>e4c81c8e-88f5-4789-8f0a-034965ec6f5e</uuid>
Nov 10 16:22:41 user nova-compute[75102]:   <name>instance-0000000d</name>
Nov 10 16:22:41 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:22:41 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:22:41 user nova-compute[75102]:   <metadata>
Nov 10 16:22:41 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:22:41 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:22:41 user nova-compute[75102]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1142194967</nova:name>
Nov 10 16:22:41 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:22:41</nova:creationTime>
Nov 10 16:22:41 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:22:41 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:22:41 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:22:41 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:22:41 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:22:41 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:22:41 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:22:41 user nova-compute[75102]:       <nova:owner>
Nov 10 16:22:41 user nova-compute[75102]:         <nova:user uuid="1471fdc4198b43adbdadb762d584acc6">tempest-VolumesAdminNegativeTest-1261870727-project-member</nova:user>
Nov 10 16:22:41 user nova-compute[75102]:         <nova:project uuid="b6ce78721e684c9581fba3a8412b6ac5">tempest-VolumesAdminNegativeTest-1261870727</nova:project>
Nov 10 16:22:41 user nova-compute[75102]:       </nova:owner>
Nov 10 16:22:41 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:22:41 user nova-compute[75102]:       <nova:ports>
Nov 10 16:22:41 user nova-compute[75102]:         <nova:port uuid="c0200ac3-e977-497b-958b-c0abe0030166">
Nov 10 16:22:41 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 16:22:41 user nova-compute[75102]:         </nova:port>
Nov 10 16:22:41 user nova-compute[75102]:       </nova:ports>
Nov 10 16:22:41 user nova-compute[75102]:     </nova:instance>
Nov 10 16:22:41 user nova-compute[75102]:   </metadata>
Nov 10 16:22:41 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:22:41 user nova-compute[75102]:     <system>
Nov 10 16:22:41 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:22:41 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:22:41 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:22:41 user nova-compute[75102]:       <entry name="serial">e4c81c8e-88f5-4789-8f0a-034965ec6f5e</entry>
Nov 10 16:22:41 user nova-compute[75102]:       <entry name="uuid">e4c81c8e-88f5-4789-8f0a-034965ec6f5e</entry>
Nov 10 16:22:41 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:22:41 user nova-compute[75102]:     </system>
Nov 10 16:22:41 user nova-compute[75102]:   </sysinfo>
Nov 10 16:22:41 user nova-compute[75102]:   <os>
Nov 10 16:22:41 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:22:41 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:22:41 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:22:41 user nova-compute[75102]:   </os>
Nov 10 16:22:41 user nova-compute[75102]:   <features>
Nov 10 16:22:41 user nova-compute[75102]:     <acpi/>
Nov 10 16:22:41 user nova-compute[75102]:     <apic/>
Nov 10 16:22:41 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:22:41 user nova-compute[75102]:   </features>
Nov 10 16:22:41 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:22:41 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:22:41 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:22:41 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:22:41 user nova-compute[75102]:   </clock>
Nov 10 16:22:41 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:22:41 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:22:41 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:22:41 user nova-compute[75102]:   </cpu>
Nov 10 16:22:41 user nova-compute[75102]:   <devices>
Nov 10 16:22:41 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:22:41 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:22:41 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk"/>
Nov 10 16:22:41 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:22:41 user nova-compute[75102]:     </disk>
Nov 10 16:22:41 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:22:41 user nova-compute[75102]:       <mac address="fa:16:3e:29:7d:ec"/>
Nov 10 16:22:41 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:22:41 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:22:41 user nova-compute[75102]:       <target dev="tapc0200ac3-e9"/>
Nov 10 16:22:41 user nova-compute[75102]:     </interface>
Nov 10 16:22:41 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:22:41 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/console.log" append="off"/>
Nov 10 16:22:41 user nova-compute[75102]:     </serial>
Nov 10 16:22:41 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:22:41 user nova-compute[75102]:     <video>
Nov 10 16:22:41 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:22:41 user nova-compute[75102]:     </video>
Nov 10 16:22:41 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:22:41 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:22:41 user nova-compute[75102]:     </rng>
Nov 10 16:22:41 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:22:41 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:22:41 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:22:41 user nova-compute[75102]:     </memballoon>
Nov 10 16:22:41 user nova-compute[75102]:   </devices>
Nov 10 16:22:41 user nova-compute[75102]: </domain>
Nov 10 16:22:41 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1142194967',display_name='tempest-VolumesAdminNegativeTest-server-1142194967',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1142194967',id=13,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJA7d6FjjU6j3Dfak75FjKZ4vc5bedosW1fEUbjJWHclvqgSiXjN/TfPuTpJgeg63aC+6yh1VVfwB/MFmn0Ge9/hUfzW1S4+wNEEFvElz9Abv04+WceiCrW6ikP/7Xlqw==',key_name='tempest-keypair-385827681',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6ce78721e684c9581fba3a8412b6ac5',ramdisk_id='',reservation_id='r-2xlooi7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1261870727',owner_user_name='tempest-VolumesAdminNegativeTest-1261870727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:22:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1471fdc4198b43adbdadb762d584acc6',uuid=e4c81c8e-88f5-4789-8f0a-034965ec6f5e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converting VIF {"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:29:7d:ec,bridge_name='br-int',has_traffic_filtering=True,id=c0200ac3-e977-497b-958b-c0abe0030166,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0200ac3-e9') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG os_vif [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7d:ec,bridge_name='br-int',has_traffic_filtering=True,id=c0200ac3-e977-497b-958b-c0abe0030166,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0200ac3-e9') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '523604c2-9e1a-5af8-89b2-22888c81ee3a', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc0200ac3-e9, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc0200ac3-e9, col_values=(('qos', UUID('05693a3f-1feb-4b9a-bf2f-0884ca2f3149')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc0200ac3-e9, col_values=(('external_ids', {'iface-id': 'c0200ac3-e977-497b-958b-c0abe0030166', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:29:7d:ec', 'vm-uuid': 'e4c81c8e-88f5-4789-8f0a-034965ec6f5e'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:41 user nova-compute[75102]: INFO os_vif [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:29:7d:ec,bridge_name='br-int',has_traffic_filtering=True,id=c0200ac3-e977-497b-958b-c0abe0030166,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0200ac3-e9')
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk 21474836480 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.objects.instance [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'flavor' on Instance uuid a8562537-34e2-45eb-835c-a4dd59e3af7c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk 21474836480" returned: 0 in 0.067s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Ensure instance console log exists: /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Start _get_guest_xml network_info=[{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884003894-network", "vif_mac": "fa:16:3e:f8:94:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '9c2e4789-561f-489e-bfaa-11d0383e949e', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '731624eb-b0c0-42c1-80cf-2dd76932e92a', 'attached_at': '2023-11-10T16:22:41.000000', 'detached_at': '', 'volume_id': '16c3c027-57d4-46aa-a334-ac1fbdf77788', 'serial': '16c3c027-57d4-46aa-a334-ac1fbdf77788'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.131s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:41 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:22:41 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] No VIF found with MAC fa:16:3e:29:7d:ec, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:12:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:22:41 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:22:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:22:41 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:22:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:22:41 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[285ba422-8daf-4432-b105-040e95c06ab6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:22:41 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b9e7c6-2dc8-45a7-be7a-1ec4d77a3127]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788] added
Nov 10 16:22:42 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[401c8040-55ed-4970-8628-2fc4c54d9e82]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c043f399-7c7c-4e50-b46a-073cc2b2b6a6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClnYeBIV {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:42 user nova-compute[75102]: INFO nova.compute.manager [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Attaching volume e35f4873-f515-4a7a-9340-f2bb821c4079 to /dev/vdb
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClnYeBIV" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee003ed-0ffc-4dd6-bd1c-a1f6d8bfca97]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ClnYeBIV'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc79262d-a458-40ca-ad3b-c9d00c734c23]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bed9f25-526b-4321-b918-868df9c04cdc]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:42 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:42 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.utils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4419a0e-e888-41da-8b00-b998c6f7c521]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b1504d5-3057-4685-9aeb-953fa0222340]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad78121-5eff-44e1-bc71-4d834ecd937f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]
Nov 10 16:22:42 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.
Nov 10 16:22:42 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ca79af-4f22-442e-a0b6-1a84acf5ad5a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a37aa9d-4819-4a0b-83b3-c3d926249b75]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.100s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[47b6902a-0b1b-4cb1-ae8e-a975f10f82f5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[29fce123-f456-4f37-aa1b-11b3317af620]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.utils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] <== get_connector_properties: return (250ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Updating existing volume attachment record: 1d6c302b-fa15-47ba-a6de-ca7d08a3ad93 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f9d776-5a31-4dde-899b-7c71bdec3091]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:42 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:22:42 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:22:42 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.535s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] HCTL ('34', '-', '-', 0) found on session 15 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e16f63-1d52-4e4f-a3f1-00378fc6eb1c]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching for a device in session 15 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG nova.network.neutron [req-721bd21f-22ba-43e9-b3be-e6803e2f6959 req-f77d3915-42dd-451c-a55c-395f2cb0916e service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Updated VIF entry in instance network info cache for port c0200ac3-e977-497b-958b-c0abe0030166. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG nova.network.neutron [req-721bd21f-22ba-43e9-b3be-e6803e2f6959 req-f77d3915-42dd-451c-a55c-395f2cb0916e service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Updating instance_info_cache with network_info: [{"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:22:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-721bd21f-22ba-43e9-b3be-e6803e2f6959 req-f77d3915-42dd-451c-a55c-395f2cb0916e service nova] Releasing lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.596s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] <== connect_volume: return (1597ms) {'type': 'block', 'scsi_wwn': '26161313932616364', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161313932616364', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1376797735',display_name='tempest-ServerActionsTestOtherB-server-1376797735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1376797735',id=3,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHr0jwe70jfLAKGRmlC9Z1xJ9zp5YI31PlNstF6fiupDKXJEjbBPAkoJ7zXlYnnaeafbpydLq7gUD5yOQPm6w6xcEQdooK67LWtISX7OzOkN1IUKn+FbDIXcoKGGroQQ==',key_name='tempest-keypair-1977714077',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7d5f31d051084698bce41a77bc9faa87',ramdisk_id='',reservation_id='r-gdlg319g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-792699016',owner_user_name='tempest-ServerActionsTestOtherB-792699016-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb6cbfdc7334af4a5e4cae046d2e6b1',uuid=731624eb-b0c0-42c1-80cf-2dd76932e92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884003894-network", "vif_mac": "fa:16:3e:f8:94:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converting VIF {"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884003894-network", "vif_mac": "fa:16:3e:f8:94:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:22:43 user nova-compute[75102]:   <uuid>731624eb-b0c0-42c1-80cf-2dd76932e92a</uuid>
Nov 10 16:22:43 user nova-compute[75102]:   <name>instance-00000003</name>
Nov 10 16:22:43 user nova-compute[75102]:   <memory>2097152</memory>
Nov 10 16:22:43 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:22:43 user nova-compute[75102]:   <metadata>
Nov 10 16:22:43 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:22:43 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:22:43 user nova-compute[75102]:       <nova:name>tempest-ServerActionsTestOtherB-server-1376797735</nova:name>
Nov 10 16:22:43 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:22:41</nova:creationTime>
Nov 10 16:22:43 user nova-compute[75102]:       <nova:flavor name="m1.small">
Nov 10 16:22:43 user nova-compute[75102]:         <nova:memory>2048</nova:memory>
Nov 10 16:22:43 user nova-compute[75102]:         <nova:disk>20</nova:disk>
Nov 10 16:22:43 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:22:43 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:22:43 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:22:43 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:22:43 user nova-compute[75102]:       <nova:owner>
Nov 10 16:22:43 user nova-compute[75102]:         <nova:user uuid="8fb6cbfdc7334af4a5e4cae046d2e6b1">tempest-ServerActionsTestOtherB-792699016-project-member</nova:user>
Nov 10 16:22:43 user nova-compute[75102]:         <nova:project uuid="7d5f31d051084698bce41a77bc9faa87">tempest-ServerActionsTestOtherB-792699016</nova:project>
Nov 10 16:22:43 user nova-compute[75102]:       </nova:owner>
Nov 10 16:22:43 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:22:43 user nova-compute[75102]:       <nova:ports>
Nov 10 16:22:43 user nova-compute[75102]:         <nova:port uuid="73a78287-ce4f-4bf1-b9aa-e5eecbc4a608">
Nov 10 16:22:43 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 16:22:43 user nova-compute[75102]:         </nova:port>
Nov 10 16:22:43 user nova-compute[75102]:       </nova:ports>
Nov 10 16:22:43 user nova-compute[75102]:     </nova:instance>
Nov 10 16:22:43 user nova-compute[75102]:   </metadata>
Nov 10 16:22:43 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:22:43 user nova-compute[75102]:     <system>
Nov 10 16:22:43 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:22:43 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:22:43 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:22:43 user nova-compute[75102]:       <entry name="serial">731624eb-b0c0-42c1-80cf-2dd76932e92a</entry>
Nov 10 16:22:43 user nova-compute[75102]:       <entry name="uuid">731624eb-b0c0-42c1-80cf-2dd76932e92a</entry>
Nov 10 16:22:43 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:22:43 user nova-compute[75102]:     </system>
Nov 10 16:22:43 user nova-compute[75102]:   </sysinfo>
Nov 10 16:22:43 user nova-compute[75102]:   <os>
Nov 10 16:22:43 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:22:43 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:22:43 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:22:43 user nova-compute[75102]:   </os>
Nov 10 16:22:43 user nova-compute[75102]:   <features>
Nov 10 16:22:43 user nova-compute[75102]:     <acpi/>
Nov 10 16:22:43 user nova-compute[75102]:     <apic/>
Nov 10 16:22:43 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:22:43 user nova-compute[75102]:   </features>
Nov 10 16:22:43 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:22:43 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:22:43 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:22:43 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:22:43 user nova-compute[75102]:   </clock>
Nov 10 16:22:43 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:22:43 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:22:43 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:22:43 user nova-compute[75102]:   </cpu>
Nov 10 16:22:43 user nova-compute[75102]:   <devices>
Nov 10 16:22:43 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:22:43 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:22:43 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk"/>
Nov 10 16:22:43 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:22:43 user nova-compute[75102]:     </disk>
Nov 10 16:22:43 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:22:43 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:22:43 user nova-compute[75102]:       <source dev="/dev/sdc"/>
Nov 10 16:22:43 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:22:43 user nova-compute[75102]:       <serial>16c3c027-57d4-46aa-a334-ac1fbdf77788</serial>
Nov 10 16:22:43 user nova-compute[75102]:     </disk>
Nov 10 16:22:43 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:22:43 user nova-compute[75102]:       <mac address="fa:16:3e:f8:94:15"/>
Nov 10 16:22:43 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:22:43 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:22:43 user nova-compute[75102]:       <target dev="tap73a78287-ce"/>
Nov 10 16:22:43 user nova-compute[75102]:     </interface>
Nov 10 16:22:43 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:22:43 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/console.log" append="off"/>
Nov 10 16:22:43 user nova-compute[75102]:     </serial>
Nov 10 16:22:43 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:22:43 user nova-compute[75102]:     <video>
Nov 10 16:22:43 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:22:43 user nova-compute[75102]:     </video>
Nov 10 16:22:43 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:22:43 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:22:43 user nova-compute[75102]:     </rng>
Nov 10 16:22:43 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:22:43 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:22:43 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:22:43 user nova-compute[75102]:     </memballoon>
Nov 10 16:22:43 user nova-compute[75102]:   </devices>
Nov 10 16:22:43 user nova-compute[75102]: </domain>
Nov 10 16:22:43 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1376797735',display_name='tempest-ServerActionsTestOtherB-server-1376797735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1376797735',id=3,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHr0jwe70jfLAKGRmlC9Z1xJ9zp5YI31PlNstF6fiupDKXJEjbBPAkoJ7zXlYnnaeafbpydLq7gUD5yOQPm6w6xcEQdooK67LWtISX7OzOkN1IUKn+FbDIXcoKGGroQQ==',key_name='tempest-keypair-1977714077',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7d5f31d051084698bce41a77bc9faa87',ramdisk_id='',reservation_id='r-gdlg319g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-792699016',owner_user_name='tempest-ServerActionsTestOtherB-792699016-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:21:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb6cbfdc7334af4a5e4cae046d2e6b1',uuid=731624eb-b0c0-42c1-80cf-2dd76932e92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884003894-network", "vif_mac": "fa:16:3e:f8:94:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converting VIF {"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-884003894-network", "vif_mac": "fa:16:3e:f8:94:15"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG os_vif [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab7b28ba-0834-56fe-8f2e-652ae41dd722', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73a78287-ce, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73a78287-ce, col_values=(('qos', UUID('3a0a416b-f640-45dc-8c92-44817f68018f')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73a78287-ce, col_values=(('external_ids', {'iface-id': '73a78287-ce4f-4bf1-b9aa-e5eecbc4a608', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:94:15', 'vm-uuid': '731624eb-b0c0-42c1-80cf-2dd76932e92a'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:43 user nova-compute[75102]: INFO os_vif [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce')
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:22:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] No VIF found with MAC fa:16:3e:f8:94:15, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:22:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:22:46 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Instance spawned successfully.
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:22:46 user nova-compute[75102]: INFO nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Took 7.38 seconds to spawn the instance on the hypervisor.
Nov 10 16:22:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:22:46 user nova-compute[75102]: INFO nova.compute.manager [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Took 8.36 seconds to build instance.
Nov 10 16:22:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8ccd1929-6f66-4a88-af12-21fdc72ee7bc tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.490s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:22:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:22:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:22:47 user nova-compute[75102]: DEBUG nova.compute.manager [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:22:47 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance running successfully.
Nov 10 16:22:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Failed to set time: agent not configured {{(pid=75102) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 16:22:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6ba94281-2ed1-434f-9969-33d8b7e66c44 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] finish_migration finished successfully. {{(pid=75102) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 16:22:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-3a4403e6-b8d1-47bc-8b65-24e2157756b1 req-3dcb5e91-7f5e-42de-a1f2-ef63df4a7254 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received event network-vif-plugged-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3a4403e6-b8d1-47bc-8b65-24e2157756b1 req-3dcb5e91-7f5e-42de-a1f2-ef63df4a7254 service nova] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3a4403e6-b8d1-47bc-8b65-24e2157756b1 req-3dcb5e91-7f5e-42de-a1f2-ef63df4a7254 service nova] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3a4403e6-b8d1-47bc-8b65-24e2157756b1 req-3dcb5e91-7f5e-42de-a1f2-ef63df4a7254 service nova] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-3a4403e6-b8d1-47bc-8b65-24e2157756b1 req-3dcb5e91-7f5e-42de-a1f2-ef63df4a7254 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] No waiting events found dispatching network-vif-plugged-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:49 user nova-compute[75102]: WARNING nova.compute.manager [req-3a4403e6-b8d1-47bc-8b65-24e2157756b1 req-3dcb5e91-7f5e-42de-a1f2-ef63df4a7254 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received unexpected event network-vif-plugged-c0200ac3-e977-497b-958b-c0abe0030166 for instance with vm_state active and task_state None.
Nov 10 16:22:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:22:50 user nova-compute[75102]: WARNING nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] While synchronizing instance power states, found 9 instances in the database and 8 instances on the hypervisor.
Nov 10 16:22:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 731624eb-b0c0-42c1-80cf-2dd76932e92a {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid ab373f84-9ba6-4336-bca7-602464b61fb3 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 6458fc11-6612-4108-addd-ce61d935431e {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 2c40f2a3-dbfb-497d-8ec3-df38105cad20 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid a8562537-34e2-45eb-835c-a4dd59e3af7c {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 5690a54a-d70d-4342-8838-5ea22588c5ef {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid e4c81c8e-88f5-4789-8f0a-034965ec6f5e {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "6458fc11-6612-4108-addd-ce61d935431e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.110s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "6458fc11-6612-4108-addd-ce61d935431e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.109s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.119s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.140s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.144s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.152s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received event network-vif-plugged-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] No waiting events found dispatching network-vif-plugged-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:51 user nova-compute[75102]: WARNING nova.compute.manager [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received unexpected event network-vif-plugged-c0200ac3-e977-497b-958b-c0abe0030166 for instance with vm_state active and task_state None.
Nov 10 16:22:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:51 user nova-compute[75102]: WARNING nova.compute.manager [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state resized and task_state None.
Nov 10 16:22:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:22:51 user nova-compute[75102]: WARNING nova.compute.manager [req-e8a16857-488d-4c53-8e70-9d10102e9c56 req-2c2c7b5d-a256-4492-b039-2001118e8730 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state resized and task_state None.
Nov 10 16:22:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:22:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:22:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:52 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:22:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:22:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json" returned: 0 in 0.275s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json" returned: 0 in 0.270s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue --force-share --output=json" returned: 0 in 0.191s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:22:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:22:56 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:22:56 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7924MB free_disk=25.463794708251953GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Applying migration context for instance 731624eb-b0c0-42c1-80cf-2dd76932e92a as it has an incoming, in-progress migration 80853650-20a2-4068-911f-57e0a491c114. Migration status is finished {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 16:22:56 user nova-compute[75102]: INFO nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating resource usage from migration 80853650-20a2-4068-911f-57e0a491c114
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ab373f84-9ba6-4336-bca7-602464b61fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6458fc11-6612-4108-addd-ce61d935431e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 2c40f2a3-dbfb-497d-8ec3-df38105cad20 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a8562537-34e2-45eb-835c-a4dd59e3af7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 5690a54a-d70d-4342-8838-5ea22588c5ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Migration 80853650-20a2-4068-911f-57e0a491c114 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:22:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:22:57 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:22:57 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:22:57 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:22:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Skipping network cache update for instance because it is being deleted. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:22:58 user nova-compute[75102]: INFO nova.compute.claims [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Claim successful on node user
Nov 10 16:22:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:22:59 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:22:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG nova.policy [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a487c00935d4baa981cc8a1567af2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3975de59dc974b5299a9765364645f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:22:59 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Creating image(s)
Nov 10 16:22:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "/opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "/opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "/opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "a6d1f157f769604b4b7c3faf716f917a6a580fc9" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:22:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "a6d1f157f769604b4b7c3faf716f917a6a580fc9" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9.part --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updating instance_info_cache with network_info: [{"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9.part --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG nova.virt.images [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] 31966772-0b33-43d9-985a-3cd863a3f140 was qcow2, converting to raw {{(pid=75102) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9.part /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9.converted {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9.part /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9.converted" returned: 0 in 0.407s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9.converted --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Successfully created port: 2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9.converted --force-share --output=json" returned: 0 in 0.304s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "a6d1f157f769604b4b7c3faf716f917a6a580fc9" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.547s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9 --force-share --output=json" returned: 0 in 0.463s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "a6d1f157f769604b4b7c3faf716f917a6a580fc9" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "a6d1f157f769604b4b7c3faf716f917a6a580fc9" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9 --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9,backing_fmt=raw /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9,backing_fmt=raw /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk 1073741824" returned: 0 in 0.130s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "a6d1f157f769604b4b7c3faf716f917a6a580fc9" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.340s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9 --force-share --output=json" returned: 0 in 0.203s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Acquiring lock "22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Lock "22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Cannot resize image /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Ensure instance console log exists: /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Successfully updated port: 2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquired lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:23:02 user nova-compute[75102]: INFO nova.compute.claims [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Claim successful on node user
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-258f7474-3761-42fa-b377-e4033b7b4276 req-e8aa2324-adf0-475e-b98a-37de55fb4d6e service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-258f7474-3761-42fa-b377-e4033b7b4276 req-e8aa2324-adf0-475e-b98a-37de55fb4d6e service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing instance network info cache due to event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-258f7474-3761-42fa-b377-e4033b7b4276 req-e8aa2324-adf0-475e-b98a-37de55fb4d6e service nova] Acquiring lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updating instance_info_cache with network_info: [{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Releasing lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Instance network_info: |[{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-258f7474-3761-42fa-b377-e4033b7b4276 req-e8aa2324-adf0-475e-b98a-37de55fb4d6e service nova] Acquired lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.network.neutron [req-258f7474-3761-42fa-b377-e4033b7b4276 req-e8aa2324-adf0-475e-b98a-37de55fb4d6e service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Start _get_guest_xml network_info=[{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:22:54Z,direct_url=<?>,disk_format='qcow2',id=31966772-0b33-43d9-985a-3cd863a3f140,min_disk=0,min_ram=0,name='tempest-scenario-img--26840559',owner='3975de59dc974b5299a9765364645f24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:22:56Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '31966772-0b33-43d9-985a-3cd863a3f140'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:23:02 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:23:02 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:22:54Z,direct_url=<?>,disk_format='qcow2',id=31966772-0b33-43d9-985a-3cd863a3f140,min_disk=0,min_ram=0,name='tempest-scenario-img--26840559',owner='3975de59dc974b5299a9765364645f24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:22:56Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:23:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646812490',display_name='tempest-TestMinimumBasicScenario-server-646812490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646812490',id=14,image_ref='31966772-0b33-43d9-985a-3cd863a3f140',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjtWoSsTuXJ+NecIc+HuGNvaUIUmHcwzGzDRU9W8SZjunZphg8d3+X9aqSrro8Y8PsmQnAUGCe5x/Av1TLTJIkCTIDnZrG5jKrew8OhuDihgqb6VnALGWyIwxRmqd8oew==',key_name='tempest-TestMinimumBasicScenario-1776384831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3975de59dc974b5299a9765364645f24',ramdisk_id='',reservation_id='r-ejr1lcoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31966772-0b33-43d9-985a-3cd863a3f140',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-86254494',owner_user_name='tempest-TestMinimumBasicScenario-86254494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:22:59Z,user_data=None,user_id='3a487c00935d4baa981cc8a1567af2a8',uuid=b1ffa0dd-1f28-40f1-83e1-4a677302483c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converting VIF {"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'pci_devices' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:23:03 user nova-compute[75102]:   <uuid>b1ffa0dd-1f28-40f1-83e1-4a677302483c</uuid>
Nov 10 16:23:03 user nova-compute[75102]:   <name>instance-0000000e</name>
Nov 10 16:23:03 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:23:03 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:23:03 user nova-compute[75102]:   <metadata>
Nov 10 16:23:03 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:23:03 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:23:03 user nova-compute[75102]:       <nova:name>tempest-TestMinimumBasicScenario-server-646812490</nova:name>
Nov 10 16:23:03 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:23:02</nova:creationTime>
Nov 10 16:23:03 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:23:03 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:23:03 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:23:03 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:23:03 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:23:03 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:23:03 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:23:03 user nova-compute[75102]:       <nova:owner>
Nov 10 16:23:03 user nova-compute[75102]:         <nova:user uuid="3a487c00935d4baa981cc8a1567af2a8">tempest-TestMinimumBasicScenario-86254494-project-member</nova:user>
Nov 10 16:23:03 user nova-compute[75102]:         <nova:project uuid="3975de59dc974b5299a9765364645f24">tempest-TestMinimumBasicScenario-86254494</nova:project>
Nov 10 16:23:03 user nova-compute[75102]:       </nova:owner>
Nov 10 16:23:03 user nova-compute[75102]:       <nova:root type="image" uuid="31966772-0b33-43d9-985a-3cd863a3f140"/>
Nov 10 16:23:03 user nova-compute[75102]:       <nova:ports>
Nov 10 16:23:03 user nova-compute[75102]:         <nova:port uuid="2e6f20ff-75fe-49df-944c-ad4040cbdcb6">
Nov 10 16:23:03 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 16:23:03 user nova-compute[75102]:         </nova:port>
Nov 10 16:23:03 user nova-compute[75102]:       </nova:ports>
Nov 10 16:23:03 user nova-compute[75102]:     </nova:instance>
Nov 10 16:23:03 user nova-compute[75102]:   </metadata>
Nov 10 16:23:03 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:23:03 user nova-compute[75102]:     <system>
Nov 10 16:23:03 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:23:03 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:23:03 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:23:03 user nova-compute[75102]:       <entry name="serial">b1ffa0dd-1f28-40f1-83e1-4a677302483c</entry>
Nov 10 16:23:03 user nova-compute[75102]:       <entry name="uuid">b1ffa0dd-1f28-40f1-83e1-4a677302483c</entry>
Nov 10 16:23:03 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:23:03 user nova-compute[75102]:     </system>
Nov 10 16:23:03 user nova-compute[75102]:   </sysinfo>
Nov 10 16:23:03 user nova-compute[75102]:   <os>
Nov 10 16:23:03 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:23:03 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:23:03 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:23:03 user nova-compute[75102]:   </os>
Nov 10 16:23:03 user nova-compute[75102]:   <features>
Nov 10 16:23:03 user nova-compute[75102]:     <acpi/>
Nov 10 16:23:03 user nova-compute[75102]:     <apic/>
Nov 10 16:23:03 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:23:03 user nova-compute[75102]:   </features>
Nov 10 16:23:03 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:23:03 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:23:03 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:23:03 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:23:03 user nova-compute[75102]:   </clock>
Nov 10 16:23:03 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:23:03 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:23:03 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:23:03 user nova-compute[75102]:   </cpu>
Nov 10 16:23:03 user nova-compute[75102]:   <devices>
Nov 10 16:23:03 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:23:03 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:23:03 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk"/>
Nov 10 16:23:03 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:23:03 user nova-compute[75102]:     </disk>
Nov 10 16:23:03 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:23:03 user nova-compute[75102]:       <mac address="fa:16:3e:d3:d8:7a"/>
Nov 10 16:23:03 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:23:03 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:23:03 user nova-compute[75102]:       <target dev="tap2e6f20ff-75"/>
Nov 10 16:23:03 user nova-compute[75102]:     </interface>
Nov 10 16:23:03 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:23:03 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/console.log" append="off"/>
Nov 10 16:23:03 user nova-compute[75102]:     </serial>
Nov 10 16:23:03 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:23:03 user nova-compute[75102]:     <video>
Nov 10 16:23:03 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:23:03 user nova-compute[75102]:     </video>
Nov 10 16:23:03 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:23:03 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:23:03 user nova-compute[75102]:     </rng>
Nov 10 16:23:03 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:23:03 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:23:03 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:23:03 user nova-compute[75102]:     </memballoon>
Nov 10 16:23:03 user nova-compute[75102]:   </devices>
Nov 10 16:23:03 user nova-compute[75102]: </domain>
Nov 10 16:23:03 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646812490',display_name='tempest-TestMinimumBasicScenario-server-646812490',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646812490',id=14,image_ref='31966772-0b33-43d9-985a-3cd863a3f140',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjtWoSsTuXJ+NecIc+HuGNvaUIUmHcwzGzDRU9W8SZjunZphg8d3+X9aqSrro8Y8PsmQnAUGCe5x/Av1TLTJIkCTIDnZrG5jKrew8OhuDihgqb6VnALGWyIwxRmqd8oew==',key_name='tempest-TestMinimumBasicScenario-1776384831',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3975de59dc974b5299a9765364645f24',ramdisk_id='',reservation_id='r-ejr1lcoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31966772-0b33-43d9-985a-3cd863a3f140',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-86254494',owner_user_name='tempest-TestMinimumBasicScenario-86254494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:22:59Z,user_data=None,user_id='3a487c00935d4baa981cc8a1567af2a8',uuid=b1ffa0dd-1f28-40f1-83e1-4a677302483c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converting VIF {"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG os_vif [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c945dd7a-ba7e-5d9a-b5ff-ba2d9915ea82', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e6f20ff-75, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e6f20ff-75, col_values=(('qos', UUID('28a52b75-cb44-4128-93e7-73afc2617764')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e6f20ff-75, col_values=(('external_ids', {'iface-id': '2e6f20ff-75fe-49df-944c-ad4040cbdcb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:d8:7a', 'vm-uuid': 'b1ffa0dd-1f28-40f1-83e1-4a677302483c'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:03 user nova-compute[75102]: INFO os_vif [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75')
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No VIF found with MAC fa:16:3e:d3:d8:7a, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.616s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:23:03 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:23:03 user nova-compute[75102]: INFO nova.virt.block_device [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Booting with volume b03c5bac-208e-456e-8148-b25c435709df at /dev/vda
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.network.neutron [req-258f7474-3761-42fa-b377-e4033b7b4276 req-e8aa2324-adf0-475e-b98a-37de55fb4d6e service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updated VIF entry in instance network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.network.neutron [req-258f7474-3761-42fa-b377-e4033b7b4276 req-e8aa2324-adf0-475e-b98a-37de55fb4d6e service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updating instance_info_cache with network_info: [{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-258f7474-3761-42fa-b377-e4033b7b4276 req-e8aa2324-adf0-475e-b98a-37de55fb4d6e service nova] Releasing lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG os_brick.utils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a25e6b-86bc-422a-b9d1-7f2b70b5269f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[74678129-017d-40e2-9275-9a46f4e0690d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d500b57e-3311-4bea-80ce-49bb53f740e0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[940e4618-fbe1-46ad-b5d7-26f26e40acff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:23:03 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:23:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea794c8-209d-4a91-99a4-b39be19e8ca7]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG os_brick.utils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] <== get_connector_properties: return (199ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating existing volume attachment record: 147e6e5d-5d65-4378-8051-3cb963bcde4e {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:23:03 user nova-compute[75102]: DEBUG nova.policy [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ee275bdeae4149fdbcce3dc87c5a0201', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93a0c1cf04ca412bbf4acbef0c5378d3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:23:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully created port: 656316fb-f82b-470c-8163-1a5eaccb6700 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG nova.compute.manager [req-8e0f1b00-aaef-4cd9-befa-b05e140ab55a req-845ae8e3-c9fd-4eec-aa18-db2c8d3ece00 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8e0f1b00-aaef-4cd9-befa-b05e140ab55a req-845ae8e3-c9fd-4eec-aa18-db2c8d3ece00 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8e0f1b00-aaef-4cd9-befa-b05e140ab55a req-845ae8e3-c9fd-4eec-aa18-db2c8d3ece00 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8e0f1b00-aaef-4cd9-befa-b05e140ab55a req-845ae8e3-c9fd-4eec-aa18-db2c8d3ece00 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG nova.compute.manager [req-8e0f1b00-aaef-4cd9-befa-b05e140ab55a req-845ae8e3-c9fd-4eec-aa18-db2c8d3ece00 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:05 user nova-compute[75102]: WARNING nova.compute.manager [req-8e0f1b00-aaef-4cd9-befa-b05e140ab55a req-845ae8e3-c9fd-4eec-aa18-db2c8d3ece00 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state building and task_state spawning.
Nov 10 16:23:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:05 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully created port: d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:23:06 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully created port: a97dc489-4174-4b90-a7f2-a99206e712c4 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:23:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "3f35d18d-c23d-4628-80e7-52e0288fc39e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:06 user nova-compute[75102]: DEBUG nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:23:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:23:06 user nova-compute[75102]: INFO nova.compute.claims [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Claim successful on node user
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully created port: da76b68c-731a-45c3-87e3-23e840a1aca6 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.704s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.network.neutron [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:23:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-b595e20d-0831-43c0-b4e5-72750ec2f962 req-c3979646-235e-40be-9f49-c709d0924887 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b595e20d-0831-43c0-b4e5-72750ec2f962 req-c3979646-235e-40be-9f49-c709d0924887 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b595e20d-0831-43c0-b4e5-72750ec2f962 req-c3979646-235e-40be-9f49-c709d0924887 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b595e20d-0831-43c0-b4e5-72750ec2f962 req-c3979646-235e-40be-9f49-c709d0924887 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-b595e20d-0831-43c0-b4e5-72750ec2f962 req-c3979646-235e-40be-9f49-c709d0924887 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:07 user nova-compute[75102]: WARNING nova.compute.manager [req-b595e20d-0831-43c0-b4e5-72750ec2f962 req-c3979646-235e-40be-9f49-c709d0924887 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state building and task_state spawning.
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.policy [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50787ee821e0400eb445fe8cd891e119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b656df48b2114d27a9bf9fe6df81037f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:23:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Instance spawned successfully.
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:23:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Creating image(s)
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "/opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "/opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully created port: 1f2d464b-7a43-4a05-98d8-1620734913ab {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:23:07 user nova-compute[75102]: INFO nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Took 8.11 seconds to spawn the instance on the hypervisor.
Nov 10 16:23:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:23:07 user nova-compute[75102]: INFO nova.compute.manager [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Took 9.13 seconds to build instance.
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4e97f1f-cc90-4fa1-b172-963af155f327 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.294s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.232s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.219s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk 1073741824" returned: 0 in 0.063s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.network.neutron [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Successfully created port: fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.242s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully updated port: 656316fb-f82b-470c-8163-1a5eaccb6700 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Cannot resize image /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Ensure instance console log exists: /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-176d3694-6bb8-4326-8716-bdfcc1b611a2 req-6e077324-f727-4fe9-a7e2-1af398ec8571 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Received event network-changed-656316fb-f82b-470c-8163-1a5eaccb6700 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-176d3694-6bb8-4326-8716-bdfcc1b611a2 req-6e077324-f727-4fe9-a7e2-1af398ec8571 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing instance network info cache due to event network-changed-656316fb-f82b-470c-8163-1a5eaccb6700. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-176d3694-6bb8-4326-8716-bdfcc1b611a2 req-6e077324-f727-4fe9-a7e2-1af398ec8571 service nova] Acquiring lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-176d3694-6bb8-4326-8716-bdfcc1b611a2 req-6e077324-f727-4fe9-a7e2-1af398ec8571 service nova] Acquired lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.network.neutron [req-176d3694-6bb8-4326-8716-bdfcc1b611a2 req-6e077324-f727-4fe9-a7e2-1af398ec8571 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing network info cache for port 656316fb-f82b-470c-8163-1a5eaccb6700 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.network.neutron [req-176d3694-6bb8-4326-8716-bdfcc1b611a2 req-6e077324-f727-4fe9-a7e2-1af398ec8571 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG nova.network.neutron [req-176d3694-6bb8-4326-8716-bdfcc1b611a2 req-6e077324-f727-4fe9-a7e2-1af398ec8571 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-176d3694-6bb8-4326-8716-bdfcc1b611a2 req-6e077324-f727-4fe9-a7e2-1af398ec8571 service nova] Releasing lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Successfully updated port: fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquired lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-5f56640e-8a3b-43e0-ac7c-d8345e8977c9 req-636f9615-f50d-4a9e-8578-4d095852d8b0 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received event network-changed-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-5f56640e-8a3b-43e0-ac7c-d8345e8977c9 req-636f9615-f50d-4a9e-8578-4d095852d8b0 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Refreshing instance network info cache due to event network-changed-fffa7769-e41a-4fc5-8a45-0ffc65620d64. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5f56640e-8a3b-43e0-ac7c-d8345e8977c9 req-636f9615-f50d-4a9e-8578-4d095852d8b0 service nova] Acquiring lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Updating instance_info_cache with network_info: [{"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Releasing lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Instance network_info: |[{"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5f56640e-8a3b-43e0-ac7c-d8345e8977c9 req-636f9615-f50d-4a9e-8578-4d095852d8b0 service nova] Acquired lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.neutron [req-5f56640e-8a3b-43e0-ac7c-d8345e8977c9 req-636f9615-f50d-4a9e-8578-4d095852d8b0 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Refreshing network info cache for port fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Start _get_guest_xml network_info=[{"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:23:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:23:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-345281466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-345281466',id=16,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2dptwEhnV8oqQzVTBTHDet0IIps9cVD4gXD7803nOOeE3P1/qJAPcymKGHN/DWmS0DGZR6lv0eYGxvfCreIvwY4U6wiUXue5qoo7/SXIvTZamd+IZZ26usOjf13+zOuQ==',key_name='tempest-keypair-1750720961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b656df48b2114d27a9bf9fe6df81037f',ramdisk_id='',reservation_id='r-syolb3ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1377452369',owner_user_name='tempest-AttachVolumeShelveTestJSON-1377452369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50787ee821e0400eb445fe8cd891e119',uuid=3f35d18d-c23d-4628-80e7-52e0288fc39e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converting VIF {"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1f:a5,bridge_name='br-int',has_traffic_filtering=True,id=fffa7769-e41a-4fc5-8a45-0ffc65620d64,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfffa7769-e4') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.objects.instance [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f35d18d-c23d-4628-80e7-52e0288fc39e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:23:09 user nova-compute[75102]:   <uuid>3f35d18d-c23d-4628-80e7-52e0288fc39e</uuid>
Nov 10 16:23:09 user nova-compute[75102]:   <name>instance-00000010</name>
Nov 10 16:23:09 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:23:09 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:23:09 user nova-compute[75102]:   <metadata>
Nov 10 16:23:09 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:23:09 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:23:09 user nova-compute[75102]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-345281466</nova:name>
Nov 10 16:23:09 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:23:09</nova:creationTime>
Nov 10 16:23:09 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:23:09 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:23:09 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:23:09 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:23:09 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:23:09 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:23:09 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:23:09 user nova-compute[75102]:       <nova:owner>
Nov 10 16:23:09 user nova-compute[75102]:         <nova:user uuid="50787ee821e0400eb445fe8cd891e119">tempest-AttachVolumeShelveTestJSON-1377452369-project-member</nova:user>
Nov 10 16:23:09 user nova-compute[75102]:         <nova:project uuid="b656df48b2114d27a9bf9fe6df81037f">tempest-AttachVolumeShelveTestJSON-1377452369</nova:project>
Nov 10 16:23:09 user nova-compute[75102]:       </nova:owner>
Nov 10 16:23:09 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:23:09 user nova-compute[75102]:       <nova:ports>
Nov 10 16:23:09 user nova-compute[75102]:         <nova:port uuid="fffa7769-e41a-4fc5-8a45-0ffc65620d64">
Nov 10 16:23:09 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 16:23:09 user nova-compute[75102]:         </nova:port>
Nov 10 16:23:09 user nova-compute[75102]:       </nova:ports>
Nov 10 16:23:09 user nova-compute[75102]:     </nova:instance>
Nov 10 16:23:09 user nova-compute[75102]:   </metadata>
Nov 10 16:23:09 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:23:09 user nova-compute[75102]:     <system>
Nov 10 16:23:09 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:23:09 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:23:09 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:23:09 user nova-compute[75102]:       <entry name="serial">3f35d18d-c23d-4628-80e7-52e0288fc39e</entry>
Nov 10 16:23:09 user nova-compute[75102]:       <entry name="uuid">3f35d18d-c23d-4628-80e7-52e0288fc39e</entry>
Nov 10 16:23:09 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:23:09 user nova-compute[75102]:     </system>
Nov 10 16:23:09 user nova-compute[75102]:   </sysinfo>
Nov 10 16:23:09 user nova-compute[75102]:   <os>
Nov 10 16:23:09 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:23:09 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:23:09 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:23:09 user nova-compute[75102]:   </os>
Nov 10 16:23:09 user nova-compute[75102]:   <features>
Nov 10 16:23:09 user nova-compute[75102]:     <acpi/>
Nov 10 16:23:09 user nova-compute[75102]:     <apic/>
Nov 10 16:23:09 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:23:09 user nova-compute[75102]:   </features>
Nov 10 16:23:09 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:23:09 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:23:09 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:23:09 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:23:09 user nova-compute[75102]:   </clock>
Nov 10 16:23:09 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:23:09 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:23:09 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:23:09 user nova-compute[75102]:   </cpu>
Nov 10 16:23:09 user nova-compute[75102]:   <devices>
Nov 10 16:23:09 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:23:09 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:23:09 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk"/>
Nov 10 16:23:09 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:23:09 user nova-compute[75102]:     </disk>
Nov 10 16:23:09 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:23:09 user nova-compute[75102]:       <mac address="fa:16:3e:6a:1f:a5"/>
Nov 10 16:23:09 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:23:09 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:23:09 user nova-compute[75102]:       <target dev="tapfffa7769-e4"/>
Nov 10 16:23:09 user nova-compute[75102]:     </interface>
Nov 10 16:23:09 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:23:09 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/console.log" append="off"/>
Nov 10 16:23:09 user nova-compute[75102]:     </serial>
Nov 10 16:23:09 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:23:09 user nova-compute[75102]:     <video>
Nov 10 16:23:09 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:23:09 user nova-compute[75102]:     </video>
Nov 10 16:23:09 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:23:09 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:23:09 user nova-compute[75102]:     </rng>
Nov 10 16:23:09 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:23:09 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:23:09 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:23:09 user nova-compute[75102]:     </memballoon>
Nov 10 16:23:09 user nova-compute[75102]:   </devices>
Nov 10 16:23:09 user nova-compute[75102]: </domain>
Nov 10 16:23:09 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-345281466',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-345281466',id=16,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2dptwEhnV8oqQzVTBTHDet0IIps9cVD4gXD7803nOOeE3P1/qJAPcymKGHN/DWmS0DGZR6lv0eYGxvfCreIvwY4U6wiUXue5qoo7/SXIvTZamd+IZZ26usOjf13+zOuQ==',key_name='tempest-keypair-1750720961',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b656df48b2114d27a9bf9fe6df81037f',ramdisk_id='',reservation_id='r-syolb3ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1377452369',owner_user_name='tempest-AttachVolumeShelveTestJSON-1377452369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:23:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50787ee821e0400eb445fe8cd891e119',uuid=3f35d18d-c23d-4628-80e7-52e0288fc39e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converting VIF {"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1f:a5,bridge_name='br-int',has_traffic_filtering=True,id=fffa7769-e41a-4fc5-8a45-0ffc65620d64,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfffa7769-e4') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG os_vif [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1f:a5,bridge_name='br-int',has_traffic_filtering=True,id=fffa7769-e41a-4fc5-8a45-0ffc65620d64,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfffa7769-e4') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6a68f385-3169-5f77-8a75-4dccfd4706b6', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfffa7769-e4, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfffa7769-e4, col_values=(('qos', UUID('e9905c3f-c750-4d5a-92a0-1d8de2013cb7')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfffa7769-e4, col_values=(('external_ids', {'iface-id': 'fffa7769-e41a-4fc5-8a45-0ffc65620d64', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:1f:a5', 'vm-uuid': '3f35d18d-c23d-4628-80e7-52e0288fc39e'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:09 user nova-compute[75102]: INFO os_vif [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1f:a5,bridge_name='br-int',has_traffic_filtering=True,id=fffa7769-e41a-4fc5-8a45-0ffc65620d64,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfffa7769-e4')
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] No VIF found with MAC fa:16:3e:6a:1f:a5, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:23:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully updated port: bb4b4391-6b40-4bc6-98ad-66e97be58187 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:23:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-5f56640e-8a3b-43e0-ac7c-d8345e8977c9 req-636f9615-f50d-4a9e-8578-4d095852d8b0 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Updated VIF entry in instance network info cache for port fffa7769-e41a-4fc5-8a45-0ffc65620d64. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:23:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-5f56640e-8a3b-43e0-ac7c-d8345e8977c9 req-636f9615-f50d-4a9e-8578-4d095852d8b0 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Updating instance_info_cache with network_info: [{"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5f56640e-8a3b-43e0-ac7c-d8345e8977c9 req-636f9615-f50d-4a9e-8578-4d095852d8b0 service nova] Releasing lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-3561cb8d-040b-4e1a-867d-6ffbfc2117ad req-36dc9ee9-8dae-4b6a-8ab4-539d7a6c6928 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Received event network-changed-bb4b4391-6b40-4bc6-98ad-66e97be58187 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-3561cb8d-040b-4e1a-867d-6ffbfc2117ad req-36dc9ee9-8dae-4b6a-8ab4-539d7a6c6928 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing instance network info cache due to event network-changed-bb4b4391-6b40-4bc6-98ad-66e97be58187. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3561cb8d-040b-4e1a-867d-6ffbfc2117ad req-36dc9ee9-8dae-4b6a-8ab4-539d7a6c6928 service nova] Acquiring lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3561cb8d-040b-4e1a-867d-6ffbfc2117ad req-36dc9ee9-8dae-4b6a-8ab4-539d7a6c6928 service nova] Acquired lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-3561cb8d-040b-4e1a-867d-6ffbfc2117ad req-36dc9ee9-8dae-4b6a-8ab4-539d7a6c6928 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing network info cache for port bb4b4391-6b40-4bc6-98ad-66e97be58187 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.volume.cinder [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Update attachment failed for attachment 1d6c302b-fa15-47ba-a6de-ca7d08a3ad93. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20cea2d8-cf0c-4211-aa98-bbc805f7673f) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20cea2d8-cf0c-4211-aa98-bbc805f7673f)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Failed to attach e35f4873-f515-4a7a-9340-f2bb821c4079 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20cea2d8-cf0c-4211-aa98-bbc805f7673f)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Traceback (most recent call last):
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     self._volume_attach(context, volume, connector, instance,
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     connection_info = volume_api.attachment_update(
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     res = method(self, ctx, *args, **kwargs)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     with excutils.save_and_reraise_exception():
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     self.force_reraise()
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     raise self.value
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     return method.func(obj, *args, **kwargs)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     return self.request(url, method, **kwargs)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c]     raise exceptions.from_response(resp, body)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20cea2d8-cf0c-4211-aa98-bbc805f7673f)
Nov 10 16:23:10 user nova-compute[75102]: ERROR nova.compute.manager [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] 
Nov 10 16:23:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-3561cb8d-040b-4e1a-867d-6ffbfc2117ad req-36dc9ee9-8dae-4b6a-8ab4-539d7a6c6928 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.933s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 20.409s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.042s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server [None req-cadfe2a8-cf90-417b-bca1-9be7ca6d9d7d tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20cea2d8-cf0c-4211-aa98-bbc805f7673f)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-20cea2d8-cf0c-4211-aa98-bbc805f7673f)
Nov 10 16:23:11 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "6458fc11-6612-4108-addd-ce61d935431e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:11 user nova-compute[75102]: INFO nova.compute.manager [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Terminating instance
Nov 10 16:23:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully updated port: 7bafa2da-f617-4bdb-8e02-0d4d99e8b603 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-3561cb8d-040b-4e1a-867d-6ffbfc2117ad req-36dc9ee9-8dae-4b6a-8ab4-539d7a6c6928 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3561cb8d-040b-4e1a-867d-6ffbfc2117ad req-36dc9ee9-8dae-4b6a-8ab4-539d7a6c6928 service nova] Releasing lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-6743cd08-8469-4499-a472-0fae6cd08b6b req-44ff2783-aaeb-4837-9553-e44cb681a784 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-unplugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6743cd08-8469-4499-a472-0fae6cd08b6b req-44ff2783-aaeb-4837-9553-e44cb681a784 service nova] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6743cd08-8469-4499-a472-0fae6cd08b6b req-44ff2783-aaeb-4837-9553-e44cb681a784 service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6743cd08-8469-4499-a472-0fae6cd08b6b req-44ff2783-aaeb-4837-9553-e44cb681a784 service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-6743cd08-8469-4499-a472-0fae6cd08b6b req-44ff2783-aaeb-4837-9553-e44cb681a784 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] No waiting events found dispatching network-vif-unplugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-6743cd08-8469-4499-a472-0fae6cd08b6b req-44ff2783-aaeb-4837-9553-e44cb681a784 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-unplugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-b5074470-af75-47e0-a2ab-31a46702588b req-67282f54-bf0b-4e8c-b936-4dd5d893a1ef service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received event network-vif-plugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b5074470-af75-47e0-a2ab-31a46702588b req-67282f54-bf0b-4e8c-b936-4dd5d893a1ef service nova] Acquiring lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b5074470-af75-47e0-a2ab-31a46702588b req-67282f54-bf0b-4e8c-b936-4dd5d893a1ef service nova] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b5074470-af75-47e0-a2ab-31a46702588b req-67282f54-bf0b-4e8c-b936-4dd5d893a1ef service nova] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-b5074470-af75-47e0-a2ab-31a46702588b req-67282f54-bf0b-4e8c-b936-4dd5d893a1ef service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] No waiting events found dispatching network-vif-plugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:11 user nova-compute[75102]: WARNING nova.compute.manager [req-b5074470-af75-47e0-a2ab-31a46702588b req-67282f54-bf0b-4e8c-b936-4dd5d893a1ef service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received unexpected event network-vif-plugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 for instance with vm_state building and task_state spawning.
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Instance destroyed successfully.
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.objects.instance [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lazy-loading 'resources' on Instance uuid 6458fc11-6612-4108-addd-ce61d935431e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:17:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-598809847',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-762086081',id=8,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFCYcmc6fbkVb87dY5vNaRKdJPEGkW/2zIEZbxcYW56VTIvJZFnE6PxiWcAsvDS1lc7Hspn+uCDjxoiD1E6lbtqupamzWdbjY1UQdTjVnbkbvuyi/ytsTEUONZgVQW/ong==',key_name='tempest-keypair-583205912',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:21:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='23ed0272e95b41a6b623002f93b1511f',ramdisk_id='',reservation_id='r-wi7m0598',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-725654860',owner_user_name='tempest-ServerActionsV293TestJSON-725654860-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:21:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0a50fb02c29f417d97115fdf45ffbcee',uuid=6458fc11-6612-4108-addd-ce61d935431e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converting VIF {"id": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "address": "fa:16:3e:5e:42:60", "network": {"id": "df654018-5a33-4981-987d-0ecd8b8c2dc5", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1461761772-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.135", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "23ed0272e95b41a6b623002f93b1511f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57d19842-a1", "ovs_interfaceid": "57d19842-a13a-4616-b2fd-9957fc90f7c7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_vif [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57d19842-a1, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8ed19630-882a-40c8-850e-8de2c93eb62e) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:23:12 user nova-compute[75102]: INFO os_vif [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5e:42:60,bridge_name='br-int',has_traffic_filtering=True,id=57d19842-a13a-4616-b2fd-9957fc90f7c7,network=Network(df654018-5a33-4981-987d-0ecd8b8c2dc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57d19842-a1')
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DMVPuJeX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:23:12 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e22b80-9826-45ec-ae54-35bee608a49f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:23:12 user nova-compute[75102]: No targets found.
Nov 10 16:23:12 user nova-compute[75102]: iSNS:
Nov 10 16:23:12 user nova-compute[75102]: No targets found.
Nov 10 16:23:12 user nova-compute[75102]: STATIC:
Nov 10 16:23:12 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159
Nov 10 16:23:12 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:23:12 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:23:12 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:23:12 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:23:12 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:23:12 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788
Nov 10 16:23:12 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:23:12 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:23:12 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:23:12 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:23:12 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:23:12 user nova-compute[75102]: FIRMWARE:
Nov 10 16:23:12 user nova-compute[75102]: No targets found.
Nov 10 16:23:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:23:12 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:23:12 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully updated port: d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9b3413-1434-4f9b-8191-685915b63c5f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c99fc6c-5fea-4b93-946f-a6e90b8c5389]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:23:12 user nova-compute[75102]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:23:12 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:23:12 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:23:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 (non-flash)
Nov 10 16:23:12 user nova-compute[75102]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:23:12 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:23:12 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:23:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7449d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159'): ({'sde'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Removing single pathed devices sde {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[50eaa70e-1c5f-442c-9a02-84bb9e51a11d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.037s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a656bd6-bff9-4db8-a0c8-fe9b9a3cc581]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Flushing IO for device /dev/sde {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f90e5c96-78fd-46c7-b9c6-19ecee6558d3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e0ca3b-7f2c-4854-a4a2-e6c9119e81de]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_2302d059', '/dev/disk/by-id/scsi-1SCST_BIO2302d059-c83e1c7e01222c5f', '/dev/disk/by-id/scsi-26338336531633765') {{(pid=85940) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f84eb308-25d0-4c7d-b003-06dbc926ad49]: (4, None) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f0d887-7541-4adb-8cec-a9716003f9fc]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[99753323-1af9-480b-a443-3bff50d2763d]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260]
Nov 10 16:23:12 user nova-compute[75102]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159, portal: 172.16.0.220,3260] successful.
Nov 10 16:23:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:aefc9e87-7a41-45fe-97a7-113f4a673159 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7836d865-0ba8-41a8-ae93-4ce17daf0b61]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.460s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] <== disconnect_volume: return (464ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:23:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Deleting instance files /opt/stack/data/nova/instances/6458fc11-6612-4108-addd-ce61d935431e_del
Nov 10 16:23:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Deletion of /opt/stack/data/nova/instances/6458fc11-6612-4108-addd-ce61d935431e_del complete
Nov 10 16:23:12 user nova-compute[75102]: INFO nova.compute.manager [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Took 1.64 seconds to destroy the instance on the hypervisor.
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 6458fc11-6612-4108-addd-ce61d935431e] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Received event network-changed-7bafa2da-f617-4bdb-8e02-0d4d99e8b603 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing instance network info cache due to event network-changed-7bafa2da-f617-4bdb-8e02-0d4d99e8b603. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] Acquiring lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] Acquired lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing network info cache for port 7bafa2da-f617-4bdb-8e02-0d4d99e8b603 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] Releasing lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Received event network-changed-d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing instance network info cache due to event network-changed-d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] Acquiring lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] Acquired lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing network info cache for port d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully updated port: a97dc489-4174-4b90-a7f2-a99206e712c4 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ea987afe-0bc7-43b4-8061-50e6403db7ec req-a5ba018b-2e69-45b3-8d08-65611f8271ca service nova] Releasing lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-845828f0-cc2c-4ea0-bdf3-155196c88801 req-0589e539-0d85-43c5-a70f-bd151a6b9c0a service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-845828f0-cc2c-4ea0-bdf3-155196c88801 req-0589e539-0d85-43c5-a70f-bd151a6b9c0a service nova] Acquiring lock "6458fc11-6612-4108-addd-ce61d935431e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-845828f0-cc2c-4ea0-bdf3-155196c88801 req-0589e539-0d85-43c5-a70f-bd151a6b9c0a service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-845828f0-cc2c-4ea0-bdf3-155196c88801 req-0589e539-0d85-43c5-a70f-bd151a6b9c0a service nova] Lock "6458fc11-6612-4108-addd-ce61d935431e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-845828f0-cc2c-4ea0-bdf3-155196c88801 req-0589e539-0d85-43c5-a70f-bd151a6b9c0a service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] No waiting events found dispatching network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:13 user nova-compute[75102]: WARNING nova.compute.manager [req-845828f0-cc2c-4ea0-bdf3-155196c88801 req-0589e539-0d85-43c5-a70f-bd151a6b9c0a service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received unexpected event network-vif-plugged-57d19842-a13a-4616-b2fd-9957fc90f7c7 for instance with vm_state active and task_state deleting.
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-34a4b35b-4435-43ca-921f-713aaadc8a4a req-5644068e-b4da-4d6c-b9aa-cf5d3eb758d1 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received event network-vif-plugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-34a4b35b-4435-43ca-921f-713aaadc8a4a req-5644068e-b4da-4d6c-b9aa-cf5d3eb758d1 service nova] Acquiring lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-34a4b35b-4435-43ca-921f-713aaadc8a4a req-5644068e-b4da-4d6c-b9aa-cf5d3eb758d1 service nova] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-34a4b35b-4435-43ca-921f-713aaadc8a4a req-5644068e-b4da-4d6c-b9aa-cf5d3eb758d1 service nova] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-34a4b35b-4435-43ca-921f-713aaadc8a4a req-5644068e-b4da-4d6c-b9aa-cf5d3eb758d1 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] No waiting events found dispatching network-vif-plugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:13 user nova-compute[75102]: WARNING nova.compute.manager [req-34a4b35b-4435-43ca-921f-713aaadc8a4a req-5644068e-b4da-4d6c-b9aa-cf5d3eb758d1 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received unexpected event network-vif-plugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 for instance with vm_state building and task_state spawning.
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:14 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Took 1.38 seconds to deallocate network for instance.
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully updated port: da76b68c-731a-45c3-87e3-23e840a1aca6 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:23:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Instance spawned successfully.
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:23:14 user nova-compute[75102]: INFO nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Took 6.99 seconds to spawn the instance on the hypervisor.
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:23:14 user nova-compute[75102]: INFO nova.compute.manager [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Took 8.13 seconds to build instance.
Nov 10 16:23:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-aada89a7-031c-4102-b617-837e66d14b32 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.285s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Received event network-changed-a97dc489-4174-4b90-a7f2-a99206e712c4 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing instance network info cache due to event network-changed-a97dc489-4174-4b90-a7f2-a99206e712c4. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] Acquiring lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] Acquired lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:14 user nova-compute[75102]: DEBUG nova.network.neutron [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing network info cache for port a97dc489-4174-4b90-a7f2-a99206e712c4 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.network.neutron [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Successfully updated port: 1f2d464b-7a43-4a05-98d8-1620734913ab {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Acquiring lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.network.neutron [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] Releasing lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Received event network-changed-da76b68c-731a-45c3-87e3-23e840a1aca6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing instance network info cache due to event network-changed-da76b68c-731a-45c3-87e3-23e840a1aca6. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] Acquiring lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] Acquired lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.network.neutron [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing network info cache for port da76b68c-731a-45c3-87e3-23e840a1aca6 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.network.neutron [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:23:15 user nova-compute[75102]: INFO nova.compute.manager [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Took 1.26 seconds to detach 1 volumes for instance.
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Deleting volume: aefc9e87-7a41-45fe-97a7-113f4a673159 {{(pid=75102) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.network.neutron [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c54dd583-9117-4bb6-a29c-ae7be265fe1a req-77659483-ca29-4054-a041-4332cefb045d service nova] Releasing lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Acquired lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-e8424eaf-e567-4c98-a88d-d07867694e30 req-5ba1a84e-3776-4ae3-b68b-34ec93b89348 service nova] [instance: 6458fc11-6612-4108-addd-ce61d935431e] Received event network-vif-deleted-57d19842-a13a-4616-b2fd-9957fc90f7c7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:16 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:23:16 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:23:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.522s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:16 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Deleted allocations for instance 6458fc11-6612-4108-addd-ce61d935431e
Nov 10 16:23:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b5bfbe1a-83b2-46aa-bb1d-a2cb89a265f1 tempest-ServerActionsV293TestJSON-725654860 tempest-ServerActionsV293TestJSON-725654860-project-member] Lock "6458fc11-6612-4108-addd-ce61d935431e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.386s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c9cdb73-3794-4054-9bb3-3cc7b5b5b146 req-68bc1005-e603-41f4-9f82-5d50660a71e9 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Received event network-changed-1f2d464b-7a43-4a05-98d8-1620734913ab {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c9cdb73-3794-4054-9bb3-3cc7b5b5b146 req-68bc1005-e603-41f4-9f82-5d50660a71e9 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing instance network info cache due to event network-changed-1f2d464b-7a43-4a05-98d8-1620734913ab. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c9cdb73-3794-4054-9bb3-3cc7b5b5b146 req-68bc1005-e603-41f4-9f82-5d50660a71e9 service nova] Acquiring lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating instance_info_cache with network_info: [{"id": "656316fb-f82b-470c-8163-1a5eaccb6700", "address": "fa:16:3e:d4:47:a8", "network": {"id": "8f58cc3c-0ecb-4881-a95a-95c95f8b529c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1011194361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap656316fb-f8", "ovs_interfaceid": "656316fb-f82b-470c-8163-1a5eaccb6700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "address": "fa:16:3e:8e:94:53", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4b4391-6b", "ovs_interfaceid": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "address": "fa:16:3e:a8:93:ec", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bafa2da-f6", "ovs_interfaceid": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "address": "fa:16:3e:20:6b:a0", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d93e-c7", "ovs_interfaceid": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a97dc489-4174-4b90-a7f2-a99206e712c4", "address": "fa:16:3e:18:35:d5", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97dc489-41", "ovs_interfaceid": "a97dc489-4174-4b90-a7f2-a99206e712c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da76b68c-731a-45c3-87e3-23e840a1aca6", "address": "fa:16:3e:53:4b:64", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda76b68c-73", "ovs_interfaceid": "da76b68c-731a-45c3-87e3-23e840a1aca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f2d464b-7a43-4a05-98d8-1620734913ab", "address": "fa:16:3e:0b:c9:c7", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2d464b-7a", "ovs_interfaceid": "1f2d464b-7a43-4a05-98d8-1620734913ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Releasing lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Instance network_info: |[{"id": "656316fb-f82b-470c-8163-1a5eaccb6700", "address": "fa:16:3e:d4:47:a8", "network": {"id": "8f58cc3c-0ecb-4881-a95a-95c95f8b529c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1011194361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap656316fb-f8", "ovs_interfaceid": "656316fb-f82b-470c-8163-1a5eaccb6700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "address": "fa:16:3e:8e:94:53", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4b4391-6b", "ovs_interfaceid": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "address": "fa:16:3e:a8:93:ec", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bafa2da-f6", "ovs_interfaceid": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "address": "fa:16:3e:20:6b:a0", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d93e-c7", "ovs_interfaceid": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a97dc489-4174-4b90-a7f2-a99206e712c4", "address": "fa:16:3e:18:35:d5", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97dc489-41", "ovs_interfaceid": "a97dc489-4174-4b90-a7f2-a99206e712c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da76b68c-731a-45c3-87e3-23e840a1aca6", "address": "fa:16:3e:53:4b:64", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda76b68c-73", "ovs_interfaceid": "da76b68c-731a-45c3-87e3-23e840a1aca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f2d464b-7a43-4a05-98d8-1620734913ab", "address": "fa:16:3e:0b:c9:c7", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2d464b-7a", "ovs_interfaceid": "1f2d464b-7a43-4a05-98d8-1620734913ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:23:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c9cdb73-3794-4054-9bb3-3cc7b5b5b146 req-68bc1005-e603-41f4-9f82-5d50660a71e9 service nova] Acquired lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-1c9cdb73-3794-4054-9bb3-3cc7b5b5b146 req-68bc1005-e603-41f4-9f82-5d50660a71e9 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Refreshing network info cache for port 1f2d464b-7a43-4a05-98d8-1620734913ab {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-1c9cdb73-3794-4054-9bb3-3cc7b5b5b146 req-68bc1005-e603-41f4-9f82-5d50660a71e9 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updated VIF entry in instance network info cache for port 1f2d464b-7a43-4a05-98d8-1620734913ab. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:23:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-1c9cdb73-3794-4054-9bb3-3cc7b5b5b146 req-68bc1005-e603-41f4-9f82-5d50660a71e9 service nova] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating instance_info_cache with network_info: [{"id": "656316fb-f82b-470c-8163-1a5eaccb6700", "address": "fa:16:3e:d4:47:a8", "network": {"id": "8f58cc3c-0ecb-4881-a95a-95c95f8b529c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1011194361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap656316fb-f8", "ovs_interfaceid": "656316fb-f82b-470c-8163-1a5eaccb6700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "address": "fa:16:3e:8e:94:53", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4b4391-6b", "ovs_interfaceid": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "address": "fa:16:3e:a8:93:ec", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bafa2da-f6", "ovs_interfaceid": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "address": "fa:16:3e:20:6b:a0", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d93e-c7", "ovs_interfaceid": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a97dc489-4174-4b90-a7f2-a99206e712c4", "address": "fa:16:3e:18:35:d5", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97dc489-41", "ovs_interfaceid": "a97dc489-4174-4b90-a7f2-a99206e712c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "da76b68c-731a-45c3-87e3-23e840a1aca6", "address": "fa:16:3e:53:4b:64", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda76b68c-73", "ovs_interfaceid": "da76b68c-731a-45c3-87e3-23e840a1aca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1f2d464b-7a43-4a05-98d8-1620734913ab", "address": "fa:16:3e:0b:c9:c7", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2d464b-7a", "ovs_interfaceid": "1f2d464b-7a43-4a05-98d8-1620734913ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c9cdb73-3794-4054-9bb3-3cc7b5b5b146 req-68bc1005-e603-41f4-9f82-5d50660a71e9 service nova] Releasing lock "refresh_cache-22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-35e50d26-e000-4508-84e9-cac3ccc3cb53 req-b35e7f30-35e4-4097-965c-36b48a50a2a2 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received event network-changed-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-35e50d26-e000-4508-84e9-cac3ccc3cb53 req-b35e7f30-35e4-4097-965c-36b48a50a2a2 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Refreshing instance network info cache due to event network-changed-08be21b4-29e4-47eb-a6b9-6453851133d2. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:23:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-35e50d26-e000-4508-84e9-cac3ccc3cb53 req-b35e7f30-35e4-4097-965c-36b48a50a2a2 service nova] Acquiring lock "refresh_cache-5690a54a-d70d-4342-8838-5ea22588c5ef" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-35e50d26-e000-4508-84e9-cac3ccc3cb53 req-b35e7f30-35e4-4097-965c-36b48a50a2a2 service nova] Acquired lock "refresh_cache-5690a54a-d70d-4342-8838-5ea22588c5ef" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-35e50d26-e000-4508-84e9-cac3ccc3cb53 req-b35e7f30-35e4-4097-965c-36b48a50a2a2 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Refreshing network info cache for port 08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:23:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:24 user nova-compute[75102]: DEBUG nova.network.neutron [req-35e50d26-e000-4508-84e9-cac3ccc3cb53 req-b35e7f30-35e4-4097-965c-36b48a50a2a2 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Updated VIF entry in instance network info cache for port 08be21b4-29e4-47eb-a6b9-6453851133d2. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:23:24 user nova-compute[75102]: DEBUG nova.network.neutron [req-35e50d26-e000-4508-84e9-cac3ccc3cb53 req-b35e7f30-35e4-4097-965c-36b48a50a2a2 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Updating instance_info_cache with network_info: [{"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-35e50d26-e000-4508-84e9-cac3ccc3cb53 req-b35e7f30-35e4-4097-965c-36b48a50a2a2 service nova] Releasing lock "refresh_cache-5690a54a-d70d-4342-8838-5ea22588c5ef" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:25 user nova-compute[75102]: INFO nova.compute.manager [None req-0d07c8d5-b0a3-4970-983d-1accfe23a127 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Unrescuing
Nov 10 16:23:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d07c8d5-b0a3-4970-983d-1accfe23a127 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:23:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d07c8d5-b0a3-4970-983d-1accfe23a127 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquired lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:23:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0d07c8d5-b0a3-4970-983d-1accfe23a127 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0d07c8d5-b0a3-4970-983d-1accfe23a127 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updating instance_info_cache with network_info: [{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d07c8d5-b0a3-4970-983d-1accfe23a127 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Releasing lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG nova.objects.instance [None req-0d07c8d5-b0a3-4970-983d-1accfe23a127 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'flavor' on Instance uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-a0000a16-7fb5-4d26-b618-79a7b060a172 req-f4ed52c3-4f15-46c6-baab-de015a1fae1b service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-unplugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a0000a16-7fb5-4d26-b618-79a7b060a172 req-f4ed52c3-4f15-46c6-baab-de015a1fae1b service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a0000a16-7fb5-4d26-b618-79a7b060a172 req-f4ed52c3-4f15-46c6-baab-de015a1fae1b service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a0000a16-7fb5-4d26-b618-79a7b060a172 req-f4ed52c3-4f15-46c6-baab-de015a1fae1b service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-a0000a16-7fb5-4d26-b618-79a7b060a172 req-f4ed52c3-4f15-46c6-baab-de015a1fae1b service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-unplugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:26 user nova-compute[75102]: WARNING nova.compute.manager [req-a0000a16-7fb5-4d26-b618-79a7b060a172 req-f4ed52c3-4f15-46c6-baab-de015a1fae1b service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-unplugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:23:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:27 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Instance destroyed successfully.
Nov 10 16:23:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-4a74185e-630e-49f2-9185-3ad9d42624f7 req-0c0cae13-ff26-478f-921f-49eb39ec3f63 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4a74185e-630e-49f2-9185-3ad9d42624f7 req-0c0cae13-ff26-478f-921f-49eb39ec3f63 service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4a74185e-630e-49f2-9185-3ad9d42624f7 req-0c0cae13-ff26-478f-921f-49eb39ec3f63 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4a74185e-630e-49f2-9185-3ad9d42624f7 req-0c0cae13-ff26-478f-921f-49eb39ec3f63 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-4a74185e-630e-49f2-9185-3ad9d42624f7 req-0c0cae13-ff26-478f-921f-49eb39ec3f63 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:28 user nova-compute[75102]: WARNING nova.compute.manager [req-4a74185e-630e-49f2-9185-3ad9d42624f7 req-0c0cae13-ff26-478f-921f-49eb39ec3f63 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:23:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:29 user nova-compute[75102]: INFO nova.compute.manager [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Detaching volume ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:23:30 user nova-compute[75102]: INFO nova.virt.block_device [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Attempting to driver detach volume ee18ac51-e08b-4fa4-9a53-1bdd104cd65b from mountpoint /dev/vdb
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Attempting to detach device vdb from instance ab373f84-9ba6-4336-bca7-602464b61fb3 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:23:30 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:23:30 user nova-compute[75102]:   <source dev="/dev/sdf"/>
Nov 10 16:23:30 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:23:30 user nova-compute[75102]:   <serial>ee18ac51-e08b-4fa4-9a53-1bdd104cd65b</serial>
Nov 10 16:23:30 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:23:30 user nova-compute[75102]: </disk>
Nov 10 16:23:30 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:23:30 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Successfully detached device vdb from instance ab373f84-9ba6-4336-bca7-602464b61fb3 from the persistent domain config.
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ab373f84-9ba6-4336-bca7-602464b61fb3 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:23:30 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:23:30 user nova-compute[75102]:   <source dev="/dev/sdf"/>
Nov 10 16:23:30 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:23:30 user nova-compute[75102]:   <serial>ee18ac51-e08b-4fa4-9a53-1bdd104cd65b</serial>
Nov 10 16:23:30 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:23:30 user nova-compute[75102]: </disk>
Nov 10 16:23:30 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ab373f84-9ba6-4336-bca7-602464b61fb3 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:30 user nova-compute[75102]: WARNING nova.compute.manager [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:23:30 user nova-compute[75102]: WARNING nova.compute.manager [req-72323717-a405-4f1b-bf11-0ee7754b77c1 req-7855cdc0-29d8-4a5b-9e45-337be476e0e0 service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:23:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0d07c8d5-b0a3-4970-983d-1accfe23a127 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:23:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:31 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lazy-loading 'flavor' on Instance uuid 5690a54a-d70d-4342-8838-5ea22588c5ef {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:23:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:32 user nova-compute[75102]: INFO nova.compute.manager [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Attaching volume 811b04e9-18ad-4edf-bab5-6c2666747cc0 to /dev/vdb
Nov 10 16:23:32 user nova-compute[75102]: DEBUG os_brick.utils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f53ccc67-9065-4f1d-bb86-832238caf616]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6008a018-a3b8-4278-b2d9-ba4b3dc17212]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c353068-9a1b-4c93-bee1-ecb15808c3b1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[470aecb0-232b-471f-b1d2-72216072c767]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:23:32 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:23:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3e708e1-a72c-4f3a-abdf-815691d3d426]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG os_brick.utils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:23:32 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Updating existing volume attachment record: afeb9b6e-13fe-47fd-8b0f-69e7a60a59c0 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:23:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:34 user nova-compute[75102]: INFO nova.compute.manager [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] Took 63.92 seconds to detach 3 volumes for instance.
Nov 10 16:23:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:34 user nova-compute[75102]: INFO nova.virt.block_device [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Booting with volume b26cf1c3-eece-4d1f-97bb-4003f20daec3 at /dev/vdb
Nov 10 16:23:34 user nova-compute[75102]: DEBUG os_brick.utils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:23:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a201a2-1f2b-441e-8cfb-55087e6241e2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb46ecf6-ab9b-4129-96a4-0ca2230c6aad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e97437e-c553-47a9-a487-4c43fa008399]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5486815b-1efa-4a03-b987-e463d3d4bd31]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:23:35 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcfdb39b-3df9-4955-ada3-7ba01d1b3766]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG os_brick.utils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] <== get_connector_properties: return (128ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating existing volume attachment record: ead15103-b81a-45de-baab-b00ef934ada4 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.462s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:35 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Deleted allocations for instance 2c40f2a3-dbfb-497d-8ec3-df38105cad20
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-afd8a92a-4180-476a-8263-0445928c22f4 tempest-TaggedBootDevicesTest-603901565 tempest-TaggedBootDevicesTest-603901565-project-member] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 73.039s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 44.726s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:35 user nova-compute[75102]: INFO nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 2c40f2a3-dbfb-497d-8ec3-df38105cad20] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 10 16:23:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "2c40f2a3-dbfb-497d-8ec3-df38105cad20" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:48 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:50 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ab373f84-9ba6-4336-bca7-602464b61fb3 is timed out.
Nov 10 16:23:50 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Successfully detached device vdb from instance ab373f84-9ba6-4336-bca7-602464b61fb3 from the live domain config.
Nov 10 16:23:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vkjGylce', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:23:50 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2defc5b6-d490-4606-8c46-001012e2ef51]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:23:50 user nova-compute[75102]: No targets found.
Nov 10 16:23:50 user nova-compute[75102]: iSNS:
Nov 10 16:23:50 user nova-compute[75102]: No targets found.
Nov 10 16:23:50 user nova-compute[75102]: STATIC:
Nov 10 16:23:50 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:23:50 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:23:50 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:23:50 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788
Nov 10 16:23:50 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:23:50 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:23:50 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b
Nov 10 16:23:50 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:23:50 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:23:50 user nova-compute[75102]: FIRMWARE:
Nov 10 16:23:50 user nova-compute[75102]: No targets found.
Nov 10 16:23:50 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:23:50 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:23:50 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea16da2-463e-4b54-adf4-537908865774]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[05b5f9fc-3804-4ade-a9ac-c2c51bab1284]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:23:50 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:23:50 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:23:50 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:23:50 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:23:50 user nova-compute[75102]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b (non-flash)
Nov 10 16:23:50 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f745c7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b'): ({'sdf'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Removing single pathed devices sdf {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6818e09-110b-4f19-88f9-de0c98b75b10]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d9a11f-7690-4742-9514-da5d3a5ca29e]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Flushing IO for device /dev/sdf {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[af276188-c96b-41f6-823a-0f2399a54314]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:23:50 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.228s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b90730-6a4b-4d18-9359-5dfc7b63c176]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] SCSI volumes sdf have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0115ec-c2a7-42dc-8e55-43193aa631d3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --logout" returned: 0 in 0.118s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3223920-bc2a-4254-97d6-7e2c91a32775]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b, portal: 172.16.0.220,3260]
Nov 10 16:23:51 user nova-compute[75102]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b, portal: 172.16.0.220,3260] successful.
Nov 10 16:23:51 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ee18ac51-e08b-4fa4-9a53-1bdd104cd65b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[19ed804f-8b8f-4a35-8b2b-c0230aa4a9b0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.585s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] <== disconnect_volume: return (586ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:51 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:52 user nova-compute[75102]: DEBUG nova.objects.instance [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lazy-loading 'flavor' on Instance uuid ab373f84-9ba6-4336-bca7-602464b61fb3 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:23:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-583b2a93-fcd1-4990-beae-56b193f15dc7 tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.364s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:53 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:54 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:54 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:23:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:23:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFuGLfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:23:58 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:23:58 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:23:58 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:23:58 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7569MB free_disk=25.30548858642578GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a2a7bc-3efe-460e-8537-5414f8d2aae1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:23:58 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f658be7-d5de-4af2-99af-263e7a263069]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0] added
Nov 10 16:23:58 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b12bc5-ba60-4dd8-9aad-07acc1180110]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee559e7-46c2-4ff8-b480-c72d4fc86700]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRFuGLfn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Applying migration context for instance 731624eb-b0c0-42c1-80cf-2dd76932e92a as it has an incoming, in-progress migration 80853650-20a2-4068-911f-57e0a491c114. Migration status is finished {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 16:23:58 user nova-compute[75102]: INFO nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating resource usage from migration 80853650-20a2-4068-911f-57e0a491c114
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BRFuGLfn" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[794260b7-b20e-4358-9b30-8ca19e7029d0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BRFuGLfn'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc90af9-c9e2-4942-943b-09fa3e98c0d7]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ab373f84-9ba6-4336-bca7-602464b61fb3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a8562537-34e2-45eb-835c-a4dd59e3af7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 5690a54a-d70d-4342-8838-5ea22588c5ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Migration 80853650-20a2-4068-911f-57e0a491c114 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b1ffa0dd-1f28-40f1-83e1-4a677302483c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=28GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[55306d25-d4b3-4a43-bac5-ef8855f6d0db]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d507f39f-c098-4100-889a-d759ebcffc95]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0, portal: 172.16.0.220,3260]
Nov 10 16:23:58 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0, portal: 172.16.0.220,3260] successful.
Nov 10 16:23:58 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e21e2a-5a43-4b81-94cd-d7d9c383e090]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5331dad0-e50a-46d2-9836-2a6920592faa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:23:58 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] HCTL ('35', '-', '-', 0) found on session 16 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[40638911-4d04-4bfb-97bf-952ce0fb9453]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:23:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.648s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:23:59 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Searching for a device in session 16 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:23:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFuGLfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:23:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:23:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26439646636653461', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:23:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26439646636653461', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:23:59 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lazy-loading 'flavor' on Instance uuid 5690a54a-d70d-4342-8838-5ea22588c5ef {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:23:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:23:59 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:23:59 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:23:59 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:23:59 user nova-compute[75102]:   <serial>811b04e9-18ad-4edf-bab5-6c2666747cc0</serial>
Nov 10 16:23:59 user nova-compute[75102]: </disk>
Nov 10 16:23:59 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:23:59 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:23:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] No VIF found with MAC fa:16:3e:77:ad:1c, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d5518c61-6ce2-4ece-b886-8e411c13aea6 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.125s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:24:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:02 user nova-compute[75102]: INFO nova.virt.block_device [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Booting with volume 3fa138f9-8e43-4106-ad76-6c7e0c6dabc6 at /dev/vdc
Nov 10 16:24:02 user nova-compute[75102]: DEBUG os_brick.utils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87f20d8-60c7-44c7-a372-8b7197374046]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d008364-ca1b-4098-81c4-0b7124a1fc0a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b978ed-6804-4192-9a1a-9956bab72479]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e222c2-0114-483a-ba9e-fb7e8531b563]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:24:02 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa673cd-8e86-455a-bdfc-148f5760c5e6]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG os_brick.utils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating existing volume attachment record: e43d8f4b-58c2-4339-9faa-469edf7c17cc {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:02 user nova-compute[75102]: INFO nova.compute.manager [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Detaching volume 811b04e9-18ad-4edf-bab5-6c2666747cc0
Nov 10 16:24:02 user nova-compute[75102]: INFO nova.virt.block_device [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Attempting to driver detach volume 811b04e9-18ad-4edf-bab5-6c2666747cc0 from mountpoint /dev/vdb
Nov 10 16:24:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Attempting to detach device vdb from instance 5690a54a-d70d-4342-8838-5ea22588c5ef from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:24:02 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:24:02 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:24:02 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:24:02 user nova-compute[75102]:   <serial>811b04e9-18ad-4edf-bab5-6c2666747cc0</serial>
Nov 10 16:24:02 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:24:02 user nova-compute[75102]: </disk>
Nov 10 16:24:02 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:24:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Successfully detached device vdb from instance 5690a54a-d70d-4342-8838-5ea22588c5ef from the persistent domain config.
Nov 10 16:24:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 5690a54a-d70d-4342-8838-5ea22588c5ef from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:24:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:24:02 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:24:02 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:24:02 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:24:02 user nova-compute[75102]:   <serial>811b04e9-18ad-4edf-bab5-6c2666747cc0</serial>
Nov 10 16:24:02 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:24:02 user nova-compute[75102]: </disk>
Nov 10 16:24:02 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:24:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 5690a54a-d70d-4342-8838-5ea22588c5ef {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:24:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:24:19 user nova-compute[75102]: INFO nova.compute.claims [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Claim successful on node user
Nov 10 16:24:19 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.562s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:24:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:24:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:24:19 user nova-compute[75102]: DEBUG nova.policy [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c2125de3b2d6404c8391d3dce984dc67', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '938b3e81d96f48d5977b4e676260a5a5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:24:20 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Creating image(s)
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:20 user nova-compute[75102]: INFO nova.compute.manager [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Terminating instance
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk 1073741824" returned: 0 in 0.057s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.239s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Successfully created port: 717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.208s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-2def0930-17ca-400d-9330-0b957d7eab6b req-5923f4ef-b4be-43e7-88dc-aeba93158ec4 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received event network-vif-unplugged-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2def0930-17ca-400d-9330-0b957d7eab6b req-5923f4ef-b4be-43e7-88dc-aeba93158ec4 service nova] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2def0930-17ca-400d-9330-0b957d7eab6b req-5923f4ef-b4be-43e7-88dc-aeba93158ec4 service nova] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2def0930-17ca-400d-9330-0b957d7eab6b req-5923f4ef-b4be-43e7-88dc-aeba93158ec4 service nova] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-2def0930-17ca-400d-9330-0b957d7eab6b req-5923f4ef-b4be-43e7-88dc-aeba93158ec4 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] No waiting events found dispatching network-vif-unplugged-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-2def0930-17ca-400d-9330-0b957d7eab6b req-5923f4ef-b4be-43e7-88dc-aeba93158ec4 service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received event network-vif-unplugged-f1e845fa-5065-4ed4-a571-28b2772e65fa for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Cannot resize image /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Ensure instance console log exists: /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Instance destroyed successfully.
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lazy-loading 'resources' on Instance uuid ab373f84-9ba6-4336-bca7-602464b61fb3 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:16:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-1459758593',display_name='tempest-TestVolumeSwap-server-1459758593',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-1459758593',id=7,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHFoncbm4njaCSeb79evVeqPNayXtMyAbOUr87JrVrJLcuEgCtFE1K2Bibbvt5ZjFomeNndGErc/6RtKWzQMRv/iC2uIt0X6/AcG6F8NQGhEeB4ZXkIqM9qZZrv06yQpzQ==',key_name='tempest-keypair-367958429',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f6afcc5c81124bfcbba292d2d765eeba',ramdisk_id='',reservation_id='r-uvtku4py',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1610141871',owner_user_name='tempest-TestVolumeSwap-1610141871-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:16:43Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='91575e6a998146d4a515f27d998f84c9',uuid=ab373f84-9ba6-4336-bca7-602464b61fb3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Converting VIF {"id": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "address": "fa:16:3e:c5:fc:2c", "network": {"id": "1d0b336a-fb58-4c59-8ccc-685737dcff4b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-122376312-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.174", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f6afcc5c81124bfcbba292d2d765eeba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf1e845fa-50", "ovs_interfaceid": "f1e845fa-5065-4ed4-a571-28b2772e65fa", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c5:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=f1e845fa-5065-4ed4-a571-28b2772e65fa,network=Network(1d0b336a-fb58-4c59-8ccc-685737dcff4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e845fa-50') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG os_vif [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=f1e845fa-5065-4ed4-a571-28b2772e65fa,network=Network(1d0b336a-fb58-4c59-8ccc-685737dcff4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e845fa-50') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf1e845fa-50, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e526b04f-c0dd-4fe0-b0b1-d5b994047ea4) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: INFO os_vif [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c5:fc:2c,bridge_name='br-int',has_traffic_filtering=True,id=f1e845fa-5065-4ed4-a571-28b2772e65fa,network=Network(1d0b336a-fb58-4c59-8ccc-685737dcff4b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf1e845fa-50')
Nov 10 16:24:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Deleting instance files /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3_del
Nov 10 16:24:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Deletion of /opt/stack/data/nova/instances/ab373f84-9ba6-4336-bca7-602464b61fb3_del complete
Nov 10 16:24:21 user nova-compute[75102]: INFO nova.compute.manager [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 16:24:21 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.neutron [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Successfully updated port: 717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquired lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.neutron [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-e822ce3b-1e65-4e93-b803-0d180b5fec28 req-6e86e6fd-73b0-47cc-84d8-fe27f730aa35 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-changed-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-e822ce3b-1e65-4e93-b803-0d180b5fec28 req-6e86e6fd-73b0-47cc-84d8-fe27f730aa35 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Refreshing instance network info cache due to event network-changed-717a43fb-d615-4290-806b-cfaa817bee6f. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e822ce3b-1e65-4e93-b803-0d180b5fec28 req-6e86e6fd-73b0-47cc-84d8-fe27f730aa35 service nova] Acquiring lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.neutron [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.neutron [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating instance_info_cache with network_info: [{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Releasing lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Instance network_info: |[{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e822ce3b-1e65-4e93-b803-0d180b5fec28 req-6e86e6fd-73b0-47cc-84d8-fe27f730aa35 service nova] Acquired lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-e822ce3b-1e65-4e93-b803-0d180b5fec28 req-6e86e6fd-73b0-47cc-84d8-fe27f730aa35 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Refreshing network info cache for port 717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Start _get_guest_xml network_info=[{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:24:21 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:24:21 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-99936376',display_name='tempest-ServerStableDeviceRescueTest-server-99936376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-99936376',id=17,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3swAiY8IXi0LnDIDxdU5FjDWvfkVZ1YU60EUEocwoFUqORwq5Ulkba+xhxutRCA/obuR4eZ0OFPXP2AvkMlrjPBU9bb7EzeBuLnkEcOhPrf7ZVeVhNdp6h6lDwURsHtg==',key_name='tempest-keypair-1511821701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938b3e81d96f48d5977b4e676260a5a5',ramdisk_id='',reservation_id='r-o2v2dsqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1704477030',owner_user_name='tempest-ServerStableDeviceRescueTest-1704477030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2125de3b2d6404c8391d3dce984dc67',uuid=1d2937fc-16d6-4167-9b43-f0f44663deda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Converting VIF {"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:38:ba,bridge_name='br-int',has_traffic_filtering=True,id=717a43fb-d615-4290-806b-cfaa817bee6f,network=Network(d2738093-d847-44d1-9d52-92240b21aa1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717a43fb-d6') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.objects.instance [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:24:21 user nova-compute[75102]:   <uuid>1d2937fc-16d6-4167-9b43-f0f44663deda</uuid>
Nov 10 16:24:21 user nova-compute[75102]:   <name>instance-00000011</name>
Nov 10 16:24:21 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:24:21 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:24:21 user nova-compute[75102]:   <metadata>
Nov 10 16:24:21 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:24:21 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:24:21 user nova-compute[75102]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-99936376</nova:name>
Nov 10 16:24:21 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:24:21</nova:creationTime>
Nov 10 16:24:21 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:24:21 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:24:21 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:24:21 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:24:21 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:24:21 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:24:21 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:24:21 user nova-compute[75102]:       <nova:owner>
Nov 10 16:24:21 user nova-compute[75102]:         <nova:user uuid="c2125de3b2d6404c8391d3dce984dc67">tempest-ServerStableDeviceRescueTest-1704477030-project-member</nova:user>
Nov 10 16:24:21 user nova-compute[75102]:         <nova:project uuid="938b3e81d96f48d5977b4e676260a5a5">tempest-ServerStableDeviceRescueTest-1704477030</nova:project>
Nov 10 16:24:21 user nova-compute[75102]:       </nova:owner>
Nov 10 16:24:21 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:24:21 user nova-compute[75102]:       <nova:ports>
Nov 10 16:24:21 user nova-compute[75102]:         <nova:port uuid="717a43fb-d615-4290-806b-cfaa817bee6f">
Nov 10 16:24:21 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 16:24:21 user nova-compute[75102]:         </nova:port>
Nov 10 16:24:21 user nova-compute[75102]:       </nova:ports>
Nov 10 16:24:21 user nova-compute[75102]:     </nova:instance>
Nov 10 16:24:21 user nova-compute[75102]:   </metadata>
Nov 10 16:24:21 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:24:21 user nova-compute[75102]:     <system>
Nov 10 16:24:21 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:24:21 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:24:21 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:24:21 user nova-compute[75102]:       <entry name="serial">1d2937fc-16d6-4167-9b43-f0f44663deda</entry>
Nov 10 16:24:21 user nova-compute[75102]:       <entry name="uuid">1d2937fc-16d6-4167-9b43-f0f44663deda</entry>
Nov 10 16:24:21 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:24:21 user nova-compute[75102]:     </system>
Nov 10 16:24:21 user nova-compute[75102]:   </sysinfo>
Nov 10 16:24:21 user nova-compute[75102]:   <os>
Nov 10 16:24:21 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:24:21 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:24:21 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:24:21 user nova-compute[75102]:   </os>
Nov 10 16:24:21 user nova-compute[75102]:   <features>
Nov 10 16:24:21 user nova-compute[75102]:     <acpi/>
Nov 10 16:24:21 user nova-compute[75102]:     <apic/>
Nov 10 16:24:21 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:24:21 user nova-compute[75102]:   </features>
Nov 10 16:24:21 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:24:21 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:24:21 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:24:21 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:24:21 user nova-compute[75102]:   </clock>
Nov 10 16:24:21 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:24:21 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:24:21 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:24:21 user nova-compute[75102]:   </cpu>
Nov 10 16:24:21 user nova-compute[75102]:   <devices>
Nov 10 16:24:21 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:24:21 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:24:21 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk"/>
Nov 10 16:24:21 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:24:21 user nova-compute[75102]:     </disk>
Nov 10 16:24:21 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:24:21 user nova-compute[75102]:       <mac address="fa:16:3e:3a:38:ba"/>
Nov 10 16:24:21 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:24:21 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:24:21 user nova-compute[75102]:       <target dev="tap717a43fb-d6"/>
Nov 10 16:24:21 user nova-compute[75102]:     </interface>
Nov 10 16:24:21 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:24:21 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/console.log" append="off"/>
Nov 10 16:24:21 user nova-compute[75102]:     </serial>
Nov 10 16:24:21 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:24:21 user nova-compute[75102]:     <video>
Nov 10 16:24:21 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:24:21 user nova-compute[75102]:     </video>
Nov 10 16:24:21 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:24:21 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:24:21 user nova-compute[75102]:     </rng>
Nov 10 16:24:21 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:24:21 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:24:21 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:24:21 user nova-compute[75102]:     </memballoon>
Nov 10 16:24:21 user nova-compute[75102]:   </devices>
Nov 10 16:24:21 user nova-compute[75102]: </domain>
Nov 10 16:24:21 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-99936376',display_name='tempest-ServerStableDeviceRescueTest-server-99936376',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-99936376',id=17,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3swAiY8IXi0LnDIDxdU5FjDWvfkVZ1YU60EUEocwoFUqORwq5Ulkba+xhxutRCA/obuR4eZ0OFPXP2AvkMlrjPBU9bb7EzeBuLnkEcOhPrf7ZVeVhNdp6h6lDwURsHtg==',key_name='tempest-keypair-1511821701',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='938b3e81d96f48d5977b4e676260a5a5',ramdisk_id='',reservation_id='r-o2v2dsqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1704477030',owner_user_name='tempest-ServerStableDeviceRescueTest-1704477030-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:24:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2125de3b2d6404c8391d3dce984dc67',uuid=1d2937fc-16d6-4167-9b43-f0f44663deda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Converting VIF {"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:38:ba,bridge_name='br-int',has_traffic_filtering=True,id=717a43fb-d615-4290-806b-cfaa817bee6f,network=Network(d2738093-d847-44d1-9d52-92240b21aa1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717a43fb-d6') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG os_vif [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:38:ba,bridge_name='br-int',has_traffic_filtering=True,id=717a43fb-d615-4290-806b-cfaa817bee6f,network=Network(d2738093-d847-44d1-9d52-92240b21aa1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717a43fb-d6') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9dbc5f94-e816-5257-b57e-3b4dfbb140b2', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap717a43fb-d6, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap717a43fb-d6, col_values=(('qos', UUID('c29e047b-6ec3-4d11-b6f4-5efd877edd30')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap717a43fb-d6, col_values=(('external_ids', {'iface-id': '717a43fb-d615-4290-806b-cfaa817bee6f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:38:ba', 'vm-uuid': '1d2937fc-16d6-4167-9b43-f0f44663deda'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:21 user nova-compute[75102]: INFO os_vif [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:38:ba,bridge_name='br-int',has_traffic_filtering=True,id=717a43fb-d615-4290-806b-cfaa817bee6f,network=Network(d2738093-d847-44d1-9d52-92240b21aa1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717a43fb-d6')
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] No VIF found with MAC fa:16:3e:3a:38:ba, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:22 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Took 0.84 seconds to deallocate network for instance.
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-819bbfe6-259a-4598-bd9c-899bd2151c9e req-38456f8f-135d-4b98-8090-a668eafa5a8f service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received event network-vif-deleted-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:22 user nova-compute[75102]: INFO nova.compute.manager [req-819bbfe6-259a-4598-bd9c-899bd2151c9e req-38456f8f-135d-4b98-8090-a668eafa5a8f service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Neutron deleted interface f1e845fa-5065-4ed4-a571-28b2772e65fa; detaching it from the instance and deleting it from the info cache
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.network.neutron [req-819bbfe6-259a-4598-bd9c-899bd2151c9e req-38456f8f-135d-4b98-8090-a668eafa5a8f service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-819bbfe6-259a-4598-bd9c-899bd2151c9e req-38456f8f-135d-4b98-8090-a668eafa5a8f service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Detach interface failed, port_id=f1e845fa-5065-4ed4-a571-28b2772e65fa, reason: Instance ab373f84-9ba6-4336-bca7-602464b61fb3 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.network.neutron [req-e822ce3b-1e65-4e93-b803-0d180b5fec28 req-6e86e6fd-73b0-47cc-84d8-fe27f730aa35 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updated VIF entry in instance network info cache for port 717a43fb-d615-4290-806b-cfaa817bee6f. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.network.neutron [req-e822ce3b-1e65-4e93-b803-0d180b5fec28 req-6e86e6fd-73b0-47cc-84d8-fe27f730aa35 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating instance_info_cache with network_info: [{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e822ce3b-1e65-4e93-b803-0d180b5fec28 req-6e86e6fd-73b0-47cc-84d8-fe27f730aa35 service nova] Releasing lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.network.neutron [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Port 73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 binding to destination host user is already ACTIVE {{(pid=75102) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquired lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.network.neutron [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.476s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:22 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Deleted allocations for instance ab373f84-9ba6-4336-bca7-602464b61fb3
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-a1eac3c5-0f7d-4882-850f-4d9d746abe15 req-f0896216-b6b0-4d2c-8da8-ce865014f79d service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received event network-vif-plugged-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a1eac3c5-0f7d-4882-850f-4d9d746abe15 req-f0896216-b6b0-4d2c-8da8-ce865014f79d service nova] Acquiring lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a1eac3c5-0f7d-4882-850f-4d9d746abe15 req-f0896216-b6b0-4d2c-8da8-ce865014f79d service nova] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a1eac3c5-0f7d-4882-850f-4d9d746abe15 req-f0896216-b6b0-4d2c-8da8-ce865014f79d service nova] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-a1eac3c5-0f7d-4882-850f-4d9d746abe15 req-f0896216-b6b0-4d2c-8da8-ce865014f79d service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] No waiting events found dispatching network-vif-plugged-f1e845fa-5065-4ed4-a571-28b2772e65fa {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:24:22 user nova-compute[75102]: WARNING nova.compute.manager [req-a1eac3c5-0f7d-4882-850f-4d9d746abe15 req-f0896216-b6b0-4d2c-8da8-ce865014f79d service nova] [instance: ab373f84-9ba6-4336-bca7-602464b61fb3] Received unexpected event network-vif-plugged-f1e845fa-5065-4ed4-a571-28b2772e65fa for instance with vm_state deleted and task_state None.
Nov 10 16:24:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3fb5097e-9be3-40a5-a999-87fd1dfa218d tempest-TestVolumeSwap-1610141871 tempest-TestVolumeSwap-1610141871-project-member] Lock "ab373f84-9ba6-4336-bca7-602464b61fb3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.464s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:23 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 5690a54a-d70d-4342-8838-5ea22588c5ef is timed out.
Nov 10 16:24:23 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Successfully detached device vdb from instance 5690a54a-d70d-4342-8838-5ea22588c5ef from the live domain config.
Nov 10 16:24:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BRFuGLfn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:24:23 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG nova.network.neutron [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Releasing lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf560fc4-8157-4ceb-8dfe-2011df55f8cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:24:23 user nova-compute[75102]: No targets found.
Nov 10 16:24:23 user nova-compute[75102]: iSNS:
Nov 10 16:24:23 user nova-compute[75102]: No targets found.
Nov 10 16:24:23 user nova-compute[75102]: STATIC:
Nov 10 16:24:23 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0
Nov 10 16:24:23 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:24:23 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:24:23 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:24:23 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:24:23 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:24:23 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788
Nov 10 16:24:23 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:24:23 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:24:23 user nova-compute[75102]: FIRMWARE:
Nov 10 16:24:23 user nova-compute[75102]: No targets found.
Nov 10 16:24:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:24:23 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:24:23 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Creating tmpfile /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/tmpv0qyi8h7 to verify with other compute node that the instance is on the same shared storage. {{(pid=75102) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b038ef2c-1366-4bcf-80df-900dc1def8b3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9630cd-60f3-43d3-92e8-1f42a131c22b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:24:23 user nova-compute[75102]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 (non-flash)
Nov 10 16:24:23 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:24:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:24:23 user nova-compute[75102]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 (non-flash)
Nov 10 16:24:23 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:24:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f745845e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f74954-23d5-442d-94d5-20c6f82fce54]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bb0449-fd8b-4227-9e31-1927b127ce4d]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a434285b-9c75-499a-9e34-243f7fc9e551]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.043s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2e74201-5858-4b80-8f18-b3f60930958e]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[684ca9dc-3bb0-4a13-b356-81bbc43df578]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.140s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0ee5ef-d4f6-49b1-8a0a-82f23c7ae21a]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0, portal: 172.16.0.220,3260]
Nov 10 16:24:23 user nova-compute[75102]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0, portal: 172.16.0.220,3260] successful.
Nov 10 16:24:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:811b04e9-18ad-4edf-bab5-6c2666747cc0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[15af4c02-cf93-43d7-9fd7-cadf5b4529b5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] <== disconnect_volume: return (423ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:24:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:24 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance destroyed successfully.
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lazy-loading 'resources' on Instance uuid 731624eb-b0c0-42c1-80cf-2dd76932e92a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1376797735',display_name='tempest-ServerActionsTestOtherB-server-1376797735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1376797735',id=3,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHr0jwe70jfLAKGRmlC9Z1xJ9zp5YI31PlNstF6fiupDKXJEjbBPAkoJ7zXlYnnaeafbpydLq7gUD5yOQPm6w6xcEQdooK67LWtISX7OzOkN1IUKn+FbDIXcoKGGroQQ==',key_name='tempest-keypair-1977714077',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:22:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d5f31d051084698bce41a77bc9faa87',ramdisk_id='',reservation_id='r-gdlg319g',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-792699016',owner_user_name='tempest-ServerActionsTestOtherB-792699016-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:22:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb6cbfdc7334af4a5e4cae046d2e6b1',uuid=731624eb-b0c0-42c1-80cf-2dd76932e92a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converting VIF {"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_vif [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73a78287-ce, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a0a416b-f640-45dc-8c92-44817f68018f) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:24 user nova-compute[75102]: INFO os_vif [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce')
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:24:24 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e107fc-06d8-40f6-9d27-00afaa5987c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:24:24 user nova-compute[75102]: No targets found.
Nov 10 16:24:24 user nova-compute[75102]: iSNS:
Nov 10 16:24:24 user nova-compute[75102]: No targets found.
Nov 10 16:24:24 user nova-compute[75102]: STATIC:
Nov 10 16:24:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:24:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:24:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:24:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788
Nov 10 16:24:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:24:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:24:24 user nova-compute[75102]: FIRMWARE:
Nov 10 16:24:24 user nova-compute[75102]: No targets found.
Nov 10 16:24:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:24:24 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:24:24 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5638ef96-9098-45e0-9c00-1eb24dda6bea]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1d4428c-a513-422a-933f-d9f9c5fe121c]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:24:24 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:24:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:24:24 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:24:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74606710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[17f0e30e-d3be-4497-9ed4-c1ac9eccdc9e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[08878a28-0ef8-4e7d-b876-0cfc747f11ba]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad81a97-8e37-44ca-8966-d23ddaafa01e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ec74a1-02aa-4a0f-87a8-40512ff2e295]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce017d1-53f8-42f0-8931-8c7be2453d04]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[32496d32-cfc0-48b9-b79d-df629a77c388]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]
Nov 10 16:24:24 user nova-compute[75102]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.
Nov 10 16:24:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8a1376-4791-4d78-9b7c-b5479ca854eb]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] <== disconnect_volume: return (348ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.objects.instance [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lazy-loading 'flavor' on Instance uuid 5690a54a-d70d-4342-8838-5ea22588c5ef {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e6c42fa4-a52b-4d8d-a778-33891034f4e7 tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.215s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-unplugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-unplugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:24:24 user nova-compute[75102]: WARNING nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-unplugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state resized and task_state resize_reverting.
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:24:24 user nova-compute[75102]: WARNING nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state resized and task_state resize_reverting.
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:24:24 user nova-compute[75102]: WARNING nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state building and task_state spawning.
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:24:24 user nova-compute[75102]: WARNING nova.compute.manager [req-67d1b333-a9f2-43c4-bf5c-c93531a1b7c3 req-eb98d8fe-23e8-46f4-87cb-8b081186b909 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state building and task_state spawning.
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.volume.cinder [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Update attachment failed for attachment e43d8f4b-58c2-4339-9faa-469edf7c17cc. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9b11dc67-223b-4ad0-81c9-2311b077ae54) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9b11dc67-223b-4ad0-81c9-2311b077ae54)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9b11dc67-223b-4ad0-81c9-2311b077ae54)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Traceback (most recent call last):
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     driver_block_device.attach_block_devices(
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     _log_and_attach(device)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     self._volume_attach(context, volume, connector, instance,
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     connection_info = volume_api.attachment_update(
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     res = method(self, ctx, *args, **kwargs)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     with excutils.save_and_reraise_exception():
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     self.force_reraise()
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     raise self.value
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     return method.func(obj, *args, **kwargs)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     return self.request(url, method, **kwargs)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd]     raise exceptions.from_response(resp, body)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9b11dc67-223b-4ad0-81c9-2311b077ae54)
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] 
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.compute.claims [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Aborting claim: <nova.compute.claims.Claim object at 0x7f5f747081c0> {{(pid=75102) abort /opt/stack/nova/nova/compute/claims.py:84}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.abort_instance_claim" :: held 0.466s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Build of instance 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9b11dc67-223b-4ad0-81c9-2311b077ae54) {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2660}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.compute.utils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Build of instance 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: {{(pid=75102) notify_about_instance_usage /opt/stack/nova/nova/compute/utils.py:430}}
Nov 10 16:24:25 user nova-compute[75102]: ERROR nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Build of instance 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9b11dc67-223b-4ad0-81c9-2311b077ae54): nova.exception.BuildAbortException: Build of instance 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd aborted: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-9b11dc67-223b-4ad0-81c9-2311b077ae54)
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Unplugging VIFs for instance {{(pid=75102) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:2996}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-15432789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-15432789',id=15,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+eeNA2P7FOVeWUqhy+lhp1fGogiXGfuj0gyeQazFCtgUJUPdx2nRGWWy8vpqRY4sUg8qyda8X5QPp/Fkt8lawRn+lxOY1sliWaOmPmYqlRMEwLq33Y9mjOkbCtiXMaWQ==',key_name='tempest-keypair-1593679201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a0c1cf04ca412bbf4acbef0c5378d3',ramdisk_id='',reservation_id='r-77vxy3n3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2089710375',owner_user_name='tempest-TaggedBootDevicesTest_v242-2089710375-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee275bdeae4149fdbcce3dc87c5a0201',uuid=22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "656316fb-f82b-470c-8163-1a5eaccb6700", "address": "fa:16:3e:d4:47:a8", "network": {"id": "8f58cc3c-0ecb-4881-a95a-95c95f8b529c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1011194361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap656316fb-f8", "ovs_interfaceid": "656316fb-f82b-470c-8163-1a5eaccb6700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converting VIF {"id": "656316fb-f82b-470c-8163-1a5eaccb6700", "address": "fa:16:3e:d4:47:a8", "network": {"id": "8f58cc3c-0ecb-4881-a95a-95c95f8b529c", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1011194361-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap656316fb-f8", "ovs_interfaceid": "656316fb-f82b-470c-8163-1a5eaccb6700", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:47:a8,bridge_name='br-int',has_traffic_filtering=True,id=656316fb-f82b-470c-8163-1a5eaccb6700,network=Network(8f58cc3c-0ecb-4881-a95a-95c95f8b529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap656316fb-f8') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:47:a8,bridge_name='br-int',has_traffic_filtering=True,id=656316fb-f82b-470c-8163-1a5eaccb6700,network=Network(8f58cc3c-0ecb-4881-a95a-95c95f8b529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap656316fb-f8') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap656316fb-f8, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:25 user nova-compute[75102]: INFO os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:47:a8,bridge_name='br-int',has_traffic_filtering=True,id=656316fb-f82b-470c-8163-1a5eaccb6700,network=Network(8f58cc3c-0ecb-4881-a95a-95c95f8b529c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap656316fb-f8')
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-15432789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-15432789',id=15,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+eeNA2P7FOVeWUqhy+lhp1fGogiXGfuj0gyeQazFCtgUJUPdx2nRGWWy8vpqRY4sUg8qyda8X5QPp/Fkt8lawRn+lxOY1sliWaOmPmYqlRMEwLq33Y9mjOkbCtiXMaWQ==',key_name='tempest-keypair-1593679201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a0c1cf04ca412bbf4acbef0c5378d3',ramdisk_id='',reservation_id='r-77vxy3n3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2089710375',owner_user_name='tempest-TaggedBootDevicesTest_v242-2089710375-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee275bdeae4149fdbcce3dc87c5a0201',uuid=22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "address": "fa:16:3e:8e:94:53", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4b4391-6b", "ovs_interfaceid": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converting VIF {"id": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "address": "fa:16:3e:8e:94:53", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.234", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbb4b4391-6b", "ovs_interfaceid": "bb4b4391-6b40-4bc6-98ad-66e97be58187", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:53,bridge_name='br-int',has_traffic_filtering=True,id=bb4b4391-6b40-4bc6-98ad-66e97be58187,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb4b4391-6b') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:53,bridge_name='br-int',has_traffic_filtering=True,id=bb4b4391-6b40-4bc6-98ad-66e97be58187,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb4b4391-6b') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbb4b4391-6b, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:25 user nova-compute[75102]: INFO os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8e:94:53,bridge_name='br-int',has_traffic_filtering=True,id=bb4b4391-6b40-4bc6-98ad-66e97be58187,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapbb4b4391-6b')
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-15432789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-15432789',id=15,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+eeNA2P7FOVeWUqhy+lhp1fGogiXGfuj0gyeQazFCtgUJUPdx2nRGWWy8vpqRY4sUg8qyda8X5QPp/Fkt8lawRn+lxOY1sliWaOmPmYqlRMEwLq33Y9mjOkbCtiXMaWQ==',key_name='tempest-keypair-1593679201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a0c1cf04ca412bbf4acbef0c5378d3',ramdisk_id='',reservation_id='r-77vxy3n3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2089710375',owner_user_name='tempest-TaggedBootDevicesTest_v242-2089710375-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee275bdeae4149fdbcce3dc87c5a0201',uuid=22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "address": "fa:16:3e:a8:93:ec", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bafa2da-f6", "ovs_interfaceid": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converting VIF {"id": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "address": "fa:16:3e:a8:93:ec", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.170", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7bafa2da-f6", "ovs_interfaceid": "7bafa2da-f617-4bdb-8e02-0d4d99e8b603", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:93:ec,bridge_name='br-int',has_traffic_filtering=True,id=7bafa2da-f617-4bdb-8e02-0d4d99e8b603,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7bafa2da-f6') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:93:ec,bridge_name='br-int',has_traffic_filtering=True,id=7bafa2da-f617-4bdb-8e02-0d4d99e8b603,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7bafa2da-f6') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7bafa2da-f6, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:25 user nova-compute[75102]: INFO os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:93:ec,bridge_name='br-int',has_traffic_filtering=True,id=7bafa2da-f617-4bdb-8e02-0d4d99e8b603,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap7bafa2da-f6')
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-15432789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-15432789',id=15,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+eeNA2P7FOVeWUqhy+lhp1fGogiXGfuj0gyeQazFCtgUJUPdx2nRGWWy8vpqRY4sUg8qyda8X5QPp/Fkt8lawRn+lxOY1sliWaOmPmYqlRMEwLq33Y9mjOkbCtiXMaWQ==',key_name='tempest-keypair-1593679201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a0c1cf04ca412bbf4acbef0c5378d3',ramdisk_id='',reservation_id='r-77vxy3n3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2089710375',owner_user_name='tempest-TaggedBootDevicesTest_v242-2089710375-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee275bdeae4149fdbcce3dc87c5a0201',uuid=22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "address": "fa:16:3e:20:6b:a0", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d93e-c7", "ovs_interfaceid": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converting VIF {"id": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "address": "fa:16:3e:20:6b:a0", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.147", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd2a4d93e-c7", "ovs_interfaceid": "d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d93e-c7') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d93e-c7') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd2a4d93e-c7, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:25 user nova-compute[75102]: INFO os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:20:6b:a0,bridge_name='br-int',has_traffic_filtering=True,id=d2a4d93e-c7b2-475b-b28a-3a7b336c5b2a,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd2a4d93e-c7')
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-15432789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-15432789',id=15,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+eeNA2P7FOVeWUqhy+lhp1fGogiXGfuj0gyeQazFCtgUJUPdx2nRGWWy8vpqRY4sUg8qyda8X5QPp/Fkt8lawRn+lxOY1sliWaOmPmYqlRMEwLq33Y9mjOkbCtiXMaWQ==',key_name='tempest-keypair-1593679201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a0c1cf04ca412bbf4acbef0c5378d3',ramdisk_id='',reservation_id='r-77vxy3n3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2089710375',owner_user_name='tempest-TaggedBootDevicesTest_v242-2089710375-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee275bdeae4149fdbcce3dc87c5a0201',uuid=22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a97dc489-4174-4b90-a7f2-a99206e712c4", "address": "fa:16:3e:18:35:d5", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97dc489-41", "ovs_interfaceid": "a97dc489-4174-4b90-a7f2-a99206e712c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converting VIF {"id": "a97dc489-4174-4b90-a7f2-a99206e712c4", "address": "fa:16:3e:18:35:d5", "network": {"id": "6cb0405c-2f24-4293-9405-bac15138beca", "bridge": "br-int", "label": "tempest-device-tagging-net1-1906380854", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.23", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa97dc489-41", "ovs_interfaceid": "a97dc489-4174-4b90-a7f2-a99206e712c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:18:35:d5,bridge_name='br-int',has_traffic_filtering=True,id=a97dc489-4174-4b90-a7f2-a99206e712c4,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97dc489-41') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:35:d5,bridge_name='br-int',has_traffic_filtering=True,id=a97dc489-4174-4b90-a7f2-a99206e712c4,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97dc489-41') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa97dc489-41, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:25 user nova-compute[75102]: INFO os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:18:35:d5,bridge_name='br-int',has_traffic_filtering=True,id=a97dc489-4174-4b90-a7f2-a99206e712c4,network=Network(6cb0405c-2f24-4293-9405-bac15138beca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa97dc489-41')
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-15432789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-15432789',id=15,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+eeNA2P7FOVeWUqhy+lhp1fGogiXGfuj0gyeQazFCtgUJUPdx2nRGWWy8vpqRY4sUg8qyda8X5QPp/Fkt8lawRn+lxOY1sliWaOmPmYqlRMEwLq33Y9mjOkbCtiXMaWQ==',key_name='tempest-keypair-1593679201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a0c1cf04ca412bbf4acbef0c5378d3',ramdisk_id='',reservation_id='r-77vxy3n3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2089710375',owner_user_name='tempest-TaggedBootDevicesTest_v242-2089710375-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee275bdeae4149fdbcce3dc87c5a0201',uuid=22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da76b68c-731a-45c3-87e3-23e840a1aca6", "address": "fa:16:3e:53:4b:64", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda76b68c-73", "ovs_interfaceid": "da76b68c-731a-45c3-87e3-23e840a1aca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converting VIF {"id": "da76b68c-731a-45c3-87e3-23e840a1aca6", "address": "fa:16:3e:53:4b:64", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda76b68c-73", "ovs_interfaceid": "da76b68c-731a-45c3-87e3-23e840a1aca6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:64,bridge_name='br-int',has_traffic_filtering=True,id=da76b68c-731a-45c3-87e3-23e840a1aca6,network=Network(60fb345d-5e86-44f6-8f28-ae23692ca775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda76b68c-73') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:64,bridge_name='br-int',has_traffic_filtering=True,id=da76b68c-731a-45c3-87e3-23e840a1aca6,network=Network(60fb345d-5e86-44f6-8f28-ae23692ca775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda76b68c-73') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda76b68c-73, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:25 user nova-compute[75102]: INFO os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:4b:64,bridge_name='br-int',has_traffic_filtering=True,id=da76b68c-731a-45c3-87e3-23e840a1aca6,network=Network(60fb345d-5e86-44f6-8f28-ae23692ca775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda76b68c-73')
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-10T16:23:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-15432789',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-15432789',id=15,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF+eeNA2P7FOVeWUqhy+lhp1fGogiXGfuj0gyeQazFCtgUJUPdx2nRGWWy8vpqRY4sUg8qyda8X5QPp/Fkt8lawRn+lxOY1sliWaOmPmYqlRMEwLq33Y9mjOkbCtiXMaWQ==',key_name='tempest-keypair-1593679201',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93a0c1cf04ca412bbf4acbef0c5378d3',ramdisk_id='',reservation_id='r-77vxy3n3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2089710375',owner_user_name='tempest-TaggedBootDevicesTest_v242-2089710375-project-member'},tags=TagList,task_state='block_device_mapping',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:23:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ee275bdeae4149fdbcce3dc87c5a0201',uuid=22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd,vcpu_model=None,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1f2d464b-7a43-4a05-98d8-1620734913ab", "address": "fa:16:3e:0b:c9:c7", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2d464b-7a", "ovs_interfaceid": "1f2d464b-7a43-4a05-98d8-1620734913ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converting VIF {"id": "1f2d464b-7a43-4a05-98d8-1620734913ab", "address": "fa:16:3e:0b:c9:c7", "network": {"id": "60fb345d-5e86-44f6-8f28-ae23692ca775", "bridge": "br-int", "label": "tempest-device-tagging-net2-1805404090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "93a0c1cf04ca412bbf4acbef0c5378d3", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1f2d464b-7a", "ovs_interfaceid": "1f2d464b-7a43-4a05-98d8-1620734913ab", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:c7,bridge_name='br-int',has_traffic_filtering=True,id=1f2d464b-7a43-4a05-98d8-1620734913ab,network=Network(60fb345d-5e86-44f6-8f28-ae23692ca775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2d464b-7a') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:c7,bridge_name='br-int',has_traffic_filtering=True,id=1f2d464b-7a43-4a05-98d8-1620734913ab,network=Network(60fb345d-5e86-44f6-8f28-ae23692ca775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2d464b-7a') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1f2d464b-7a, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:25 user nova-compute[75102]: INFO os_vif [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:c9:c7,bridge_name='br-int',has_traffic_filtering=True,id=1f2d464b-7a43-4a05-98d8-1620734913ab,network=Network(60fb345d-5e86-44f6-8f28-ae23692ca775),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1f2d464b-7a')
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Unplugged VIFs for instance {{(pid=75102) _cleanup_allocated_networks /opt/stack/nova/nova/compute/manager.py:3032}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lazy-loading 'migration_context' on Instance uuid 731624eb-b0c0-42c1-80cf-2dd76932e92a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:24:25 user nova-compute[75102]: DEBUG nova.objects.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Object Instance<731624eb-b0c0-42c1-80cf-2dd76932e92a> lazy-loaded attributes: resources,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:24:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Instance spawned successfully.
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:24:26 user nova-compute[75102]: INFO nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Took 6.18 seconds to spawn the instance on the hypervisor.
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.479s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:26 user nova-compute[75102]: INFO nova.compute.manager [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Took 7.17 seconds to build instance.
Nov 10 16:24:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5cb6b1ad-66e4-40fb-8c8b-ab4197a2c0f0 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.345s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:26 user nova-compute[75102]: INFO nova.compute.manager [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Swapping old allocation on dict_keys(['fe24d663-5905-4042-a478-befa03efc244']) held by migration 80853650-20a2-4068-911f-57e0a491c114 for instance
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Overwriting current allocation {'allocations': {'fe24d663-5905-4042-a478-befa03efc244': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 21}}, 'project_id': '7d5f31d051084698bce41a77bc9faa87', 'user_id': '8fb6cbfdc7334af4a5e4cae046d2e6b1', 'consumer_generation': 1} on consumer 731624eb-b0c0-42c1-80cf-2dd76932e92a {{(pid=75102) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquired lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:24:26 user nova-compute[75102]: DEBUG nova.network.neutron [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG nova.network.neutron [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Releasing lock "refresh_cache-731624eb-b0c0-42c1-80cf-2dd76932e92a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG os_brick.utils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f7bbb3-47a4-44c1-a579-79a033204db0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[646dee26-9849-44d8-a88d-e2ca7bbad9b8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d64844d2-5b38-497b-9be9-1251d8db2eff]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d6c9ed-8d55-47b1-bbcd-1087cce9eccc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:24:27 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:24:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeae87a-c278-4981-a986-3616967d0a2c]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:24:27 user nova-compute[75102]: DEBUG os_brick.utils [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:24:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-0fbdade5-c9a3-40db-98c3-0cc1ae24b459 req-29332569-a75f-41e2-bcfb-480c978b652c service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received event network-changed-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-0fbdade5-c9a3-40db-98c3-0cc1ae24b459 req-29332569-a75f-41e2-bcfb-480c978b652c service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Refreshing instance network info cache due to event network-changed-c0200ac3-e977-497b-958b-c0abe0030166. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:24:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0fbdade5-c9a3-40db-98c3-0cc1ae24b459 req-29332569-a75f-41e2-bcfb-480c978b652c service nova] Acquiring lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:24:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0fbdade5-c9a3-40db-98c3-0cc1ae24b459 req-29332569-a75f-41e2-bcfb-480c978b652c service nova] Acquired lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:24:28 user nova-compute[75102]: DEBUG nova.network.neutron [req-0fbdade5-c9a3-40db-98c3-0cc1ae24b459 req-29332569-a75f-41e2-bcfb-480c978b652c service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Refreshing network info cache for port c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:24:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:29 user nova-compute[75102]: DEBUG nova.network.neutron [req-0fbdade5-c9a3-40db-98c3-0cc1ae24b459 req-29332569-a75f-41e2-bcfb-480c978b652c service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Updated VIF entry in instance network info cache for port c0200ac3-e977-497b-958b-c0abe0030166. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:24:29 user nova-compute[75102]: DEBUG nova.network.neutron [req-0fbdade5-c9a3-40db-98c3-0cc1ae24b459 req-29332569-a75f-41e2-bcfb-480c978b652c service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Updating instance_info_cache with network_info: [{"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0fbdade5-c9a3-40db-98c3-0cc1ae24b459 req-29332569-a75f-41e2-bcfb-480c978b652c service nova] Releasing lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:24:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:29 user nova-compute[75102]: INFO nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Took 3.93 seconds to deallocate network for instance.
Nov 10 16:24:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Detaching volume: b03c5bac-208e-456e-8148-b25c435709df {{(pid=75102) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 16:24:29 user nova-compute[75102]: INFO nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Detaching volume b03c5bac-208e-456e-8148-b25c435709df
Nov 10 16:24:29 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Skipping driver_detach during remote rebuild. {{(pid=75102) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 16:24:31 user nova-compute[75102]: WARNING nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Failed to detach volume: b03c5bac-208e-456e-8148-b25c435709df due to 'NoneType' object has no attribute 'devices'
Nov 10 16:24:31 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Detaching volume: b26cf1c3-eece-4d1f-97bb-4003f20daec3 {{(pid=75102) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 16:24:31 user nova-compute[75102]: INFO nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Detaching volume b26cf1c3-eece-4d1f-97bb-4003f20daec3
Nov 10 16:24:31 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Skipping driver_detach during remote rebuild. {{(pid=75102) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 16:24:32 user nova-compute[75102]: WARNING nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Failed to detach volume: b26cf1c3-eece-4d1f-97bb-4003f20daec3 due to 'NoneType' object has no attribute 'devices'
Nov 10 16:24:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Detaching volume: 3fa138f9-8e43-4106-ad76-6c7e0c6dabc6 {{(pid=75102) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3224}}
Nov 10 16:24:32 user nova-compute[75102]: INFO nova.compute.manager [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Detaching volume 3fa138f9-8e43-4106-ad76-6c7e0c6dabc6
Nov 10 16:24:32 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] [instance: 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd] Skipping driver_detach during remote rebuild. {{(pid=75102) _do_detach /opt/stack/nova/nova/virt/block_device.py:461}}
Nov 10 16:24:32 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Deleted allocations for instance 22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd
Nov 10 16:24:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b94af44e-3fc1-4e01-950e-83e8942252ac tempest-TaggedBootDevicesTest_v242-2089710375 tempest-TaggedBootDevicesTest_v242-2089710375-project-member] Lock "22b1ffb5-682d-4ea5-bf44-f2d29d2cdcdd" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 90.256s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:35 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lazy-loading 'flavor' on Instance uuid e4c81c8e-88f5-4789-8f0a-034965ec6f5e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:24:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:35 user nova-compute[75102]: INFO nova.compute.manager [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Attaching volume 9ae787c7-11b1-4864-82d9-c9a9a82404d7 to /dev/vdb
Nov 10 16:24:35 user nova-compute[75102]: DEBUG os_brick.utils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:24:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e67638-6b89-489a-a80e-5bf267c73be5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f81f2b1-d1fd-4a92-9bd6-079a6447a139]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c80f3e79-f7bc-4aaf-952b-319baf7c30e4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[22cc3187-ce48-42c3-a3e2-51c6755c2bd0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:24:36 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:24:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[738122f1-3b9d-42f5-904d-76ef510d1d80]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG os_brick.utils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:24:36 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Updating existing volume attachment record: b0909718-591c-4184-91a9-de4d7ded6956 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:24:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:48 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:24:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:24:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:24:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:51 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:24:52 user nova-compute[75102]: INFO nova.compute.claims [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Claim successful on node user
Nov 10 16:24:52 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.537s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG nova.network.neutron [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:24:53 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:24:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG nova.policy [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c97d44d1a1a4d3ba6f7e4f7f57dcbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bfa048a64b74cef84d4645eb627c0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:24:53 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Creating image(s)
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "/opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "/opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.253s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.183s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk 1073741824" returned: 0 in 0.063s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.256s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.217s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk --force-share --output=json" returned: 0 in 0.280s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Cannot resize image /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Ensure instance console log exists: /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Successfully created port: 11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Starting finish_revert_migration {{(pid=75102) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Start _get_guest_xml network_info=[{"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '57f4f96c-64af-4313-ae8d-f7207f93bc10', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '731624eb-b0c0-42c1-80cf-2dd76932e92a', 'attached_at': '2023-11-10T16:24:54.000000', 'detached_at': '', 'volume_id': '16c3c027-57d4-46aa-a334-ac1fbdf77788', 'serial': '16c3c027-57d4-46aa-a334-ac1fbdf77788'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:24:54 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:24:54 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lazy-loading 'vcpu_model' on Instance uuid 731624eb-b0c0-42c1-80cf-2dd76932e92a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:24:54 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:24:54 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:24:54 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c007de-4757-4751-ab38-cfbd81b05bef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:24:54 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f479682c-5286-4b5f-9251-ebbd7967c243]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788] added
Nov 10 16:24:54 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc0d5d5-4bac-4b00-9517-d0b9e4d39423]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5105b728-703f-45ff-9b69-a8e2962782f6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClnYeBIV {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ClnYeBIV" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef44197f-7fc0-4013-9774-bb59640c1d71]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ClnYeBIV'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d9a2cd3-b78f-44ef-bfac-bb9b68d3f9e2]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3802806-df6e-4230-b5a8-d3e034890060]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:24:54 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:24:54 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c7fb846-84a2-4a4b-849f-88c82cf5801b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]
Nov 10 16:24:54 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.
Nov 10 16:24:54 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[41a147a3-6978-4e31-b75f-918b39dd3536]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:24:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0203adbd-b15c-4054-be66-accdb805f57f]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:24:55 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:24:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:24:55 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:24:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.395s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] HCTL ('34', '-', '-', 0) found on session 17 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d096efb-fb66-4fdd-9329-4404326a9536]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Searching for a device in session 17 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG nova.network.neutron [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Successfully updated port: 11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG nova.compute.manager [req-f64cfc9b-726c-447b-8b40-a48155b60b7b req-129a4a9e-7094-47f9-9f1d-1f1605b35767 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received event network-changed-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG nova.compute.manager [req-f64cfc9b-726c-447b-8b40-a48155b60b7b req-129a4a9e-7094-47f9-9f1d-1f1605b35767 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Refreshing instance network info cache due to event network-changed-11ba77e8-7336-4d39-8527-742d639d4f5a. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f64cfc9b-726c-447b-8b40-a48155b60b7b req-129a4a9e-7094-47f9-9f1d-1f1605b35767 service nova] Acquiring lock "refresh_cache-f8de1318-fb15-4b5e-9b28-69047b6d48ac" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f64cfc9b-726c-447b-8b40-a48155b60b7b req-129a4a9e-7094-47f9-9f1d-1f1605b35767 service nova] Acquired lock "refresh_cache-f8de1318-fb15-4b5e-9b28-69047b6d48ac" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-f64cfc9b-726c-447b-8b40-a48155b60b7b req-129a4a9e-7094-47f9-9f1d-1f1605b35767 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Refreshing network info cache for port 11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "refresh_cache-f8de1318-fb15-4b5e-9b28-69047b6d48ac" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'flavor' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.176s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-f64cfc9b-726c-447b-8b40-a48155b60b7b req-129a4a9e-7094-47f9-9f1d-1f1605b35767 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:24:56 user nova-compute[75102]: INFO nova.compute.manager [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Attaching volume 47a37063-5d3a-443d-a66d-331b3fc1b881 to /dev/vdb
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.neutron [req-f64cfc9b-726c-447b-8b40-a48155b60b7b req-129a4a9e-7094-47f9-9f1d-1f1605b35767 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.481s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] <== connect_volume: return (1482ms) {'type': 'block', 'scsi_wwn': '26161313932616364', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161313932616364', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef/disk --force-share --output=json" returned: 0 in 0.583s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f64cfc9b-726c-447b-8b40-a48155b60b7b req-129a4a9e-7094-47f9-9f1d-1f1605b35767 service nova] Releasing lock "refresh_cache-f8de1318-fb15-4b5e-9b28-69047b6d48ac" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquired lock "refresh_cache-f8de1318-fb15-4b5e-9b28-69047b6d48ac" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1376797735',display_name='tempest-ServerActionsTestOtherB-server-1376797735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1376797735',id=3,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHr0jwe70jfLAKGRmlC9Z1xJ9zp5YI31PlNstF6fiupDKXJEjbBPAkoJ7zXlYnnaeafbpydLq7gUD5yOQPm6w6xcEQdooK67LWtISX7OzOkN1IUKn+FbDIXcoKGGroQQ==',key_name='tempest-keypair-1977714077',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:22:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7d5f31d051084698bce41a77bc9faa87',ramdisk_id='',reservation_id='r-gdlg319g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-792699016',owner_user_name='tempest-ServerActionsTestOtherB-792699016-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb6cbfdc7334af4a5e4cae046d2e6b1',uuid=731624eb-b0c0-42c1-80cf-2dd76932e92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converting VIF {"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:24:56 user nova-compute[75102]:   <uuid>731624eb-b0c0-42c1-80cf-2dd76932e92a</uuid>
Nov 10 16:24:56 user nova-compute[75102]:   <name>instance-00000003</name>
Nov 10 16:24:56 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:24:56 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:24:56 user nova-compute[75102]:   <metadata>
Nov 10 16:24:56 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:24:56 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:name>tempest-ServerActionsTestOtherB-server-1376797735</nova:name>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:24:54</nova:creationTime>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:24:56 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:24:56 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:owner>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:user uuid="8fb6cbfdc7334af4a5e4cae046d2e6b1">tempest-ServerActionsTestOtherB-792699016-project-member</nova:user>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:project uuid="7d5f31d051084698bce41a77bc9faa87">tempest-ServerActionsTestOtherB-792699016</nova:project>
Nov 10 16:24:56 user nova-compute[75102]:       </nova:owner>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:ports>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:port uuid="73a78287-ce4f-4bf1-b9aa-e5eecbc4a608">
Nov 10 16:24:56 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 16:24:56 user nova-compute[75102]:         </nova:port>
Nov 10 16:24:56 user nova-compute[75102]:       </nova:ports>
Nov 10 16:24:56 user nova-compute[75102]:     </nova:instance>
Nov 10 16:24:56 user nova-compute[75102]:   </metadata>
Nov 10 16:24:56 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:24:56 user nova-compute[75102]:     <system>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="serial">731624eb-b0c0-42c1-80cf-2dd76932e92a</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="uuid">731624eb-b0c0-42c1-80cf-2dd76932e92a</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:24:56 user nova-compute[75102]:     </system>
Nov 10 16:24:56 user nova-compute[75102]:   </sysinfo>
Nov 10 16:24:56 user nova-compute[75102]:   <os>
Nov 10 16:24:56 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:24:56 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:24:56 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:24:56 user nova-compute[75102]:   </os>
Nov 10 16:24:56 user nova-compute[75102]:   <features>
Nov 10 16:24:56 user nova-compute[75102]:     <acpi/>
Nov 10 16:24:56 user nova-compute[75102]:     <apic/>
Nov 10 16:24:56 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:24:56 user nova-compute[75102]:   </features>
Nov 10 16:24:56 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:24:56 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:24:56 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:24:56 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:24:56 user nova-compute[75102]:   </clock>
Nov 10 16:24:56 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:24:56 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:24:56 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:24:56 user nova-compute[75102]:   </cpu>
Nov 10 16:24:56 user nova-compute[75102]:   <devices>
Nov 10 16:24:56 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:24:56 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:24:56 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk"/>
Nov 10 16:24:56 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:24:56 user nova-compute[75102]:     </disk>
Nov 10 16:24:56 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:24:56 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:24:56 user nova-compute[75102]:       <source dev="/dev/sdc"/>
Nov 10 16:24:56 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:24:56 user nova-compute[75102]:       <serial>16c3c027-57d4-46aa-a334-ac1fbdf77788</serial>
Nov 10 16:24:56 user nova-compute[75102]:     </disk>
Nov 10 16:24:56 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:24:56 user nova-compute[75102]:       <mac address="fa:16:3e:f8:94:15"/>
Nov 10 16:24:56 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:24:56 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:24:56 user nova-compute[75102]:       <target dev="tap73a78287-ce"/>
Nov 10 16:24:56 user nova-compute[75102]:     </interface>
Nov 10 16:24:56 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:24:56 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/console.log" append="off"/>
Nov 10 16:24:56 user nova-compute[75102]:     </serial>
Nov 10 16:24:56 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:24:56 user nova-compute[75102]:     <video>
Nov 10 16:24:56 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:24:56 user nova-compute[75102]:     </video>
Nov 10 16:24:56 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:24:56 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:24:56 user nova-compute[75102]:     </rng>
Nov 10 16:24:56 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:24:56 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:24:56 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:24:56 user nova-compute[75102]:     </memballoon>
Nov 10 16:24:56 user nova-compute[75102]:   </devices>
Nov 10 16:24:56 user nova-compute[75102]: </domain>
Nov 10 16:24:56 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1376797735',display_name='tempest-ServerActionsTestOtherB-server-1376797735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1376797735',id=3,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHr0jwe70jfLAKGRmlC9Z1xJ9zp5YI31PlNstF6fiupDKXJEjbBPAkoJ7zXlYnnaeafbpydLq7gUD5yOQPm6w6xcEQdooK67LWtISX7OzOkN1IUKn+FbDIXcoKGGroQQ==',key_name='tempest-keypair-1977714077',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:22:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='7d5f31d051084698bce41a77bc9faa87',ramdisk_id='',reservation_id='r-gdlg319g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-792699016',owner_user_name='tempest-ServerActionsTestOtherB-792699016-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:24:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb6cbfdc7334af4a5e4cae046d2e6b1',uuid=731624eb-b0c0-42c1-80cf-2dd76932e92a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converting VIF {"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_vif [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_brick.utils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ab7b28ba-0834-56fe-8f2e-652ae41dd722', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e5ee64-7845-4fb2-a764-805322767cd0]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73a78287-ce, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73a78287-ce, col_values=(('qos', UUID('f7116d09-fbfb-414c-a1a5-0a7e7e9d7f97')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73a78287-ce, col_values=(('external_ids', {'iface-id': '73a78287-ce4f-4bf1-b9aa-e5eecbc4a608', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f8:94:15', 'vm-uuid': '731624eb-b0c0-42c1-80cf-2dd76932e92a'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fbee3d-b001-465e-b265-ca8efac83d8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:56 user nova-compute[75102]: INFO os_vif [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce')
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[647c6f22-3ce6-485c-98ed-251b8f903320]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6afeccd0-b069-4cdd-aff4-b2f0c3781bdc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:24:56 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b215724-1d94-4324-b720-56332271846d]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_brick.utils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] <== get_connector_properties: return (233ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updating existing volume attachment record: 3f0d113e-8892-4146-873c-f34e8c193ce1 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Updating instance_info_cache with network_info: [{"id": "11ba77e8-7336-4d39-8527-742d639d4f5a", "address": "fa:16:3e:53:82:95", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba77e8-73", "ovs_interfaceid": "11ba77e8-7336-4d39-8527-742d639d4f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Releasing lock "refresh_cache-f8de1318-fb15-4b5e-9b28-69047b6d48ac" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Instance network_info: |[{"id": "11ba77e8-7336-4d39-8527-742d639d4f5a", "address": "fa:16:3e:53:82:95", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba77e8-73", "ovs_interfaceid": "11ba77e8-7336-4d39-8527-742d639d4f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Start _get_guest_xml network_info=[{"id": "11ba77e8-7336-4d39-8527-742d639d4f5a", "address": "fa:16:3e:53:82:95", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba77e8-73", "ovs_interfaceid": "11ba77e8-7336-4d39-8527-742d639d4f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:24:56 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:24:56 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-156871188',display_name='tempest-VolumesActionsTest-instance-156871188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-156871188',id=18,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bfa048a64b74cef84d4645eb627c0eb',ramdisk_id='',reservation_id='r-oxriofft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-880387838',owner_user_name='tempest-VolumesActionsTest-880387838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:24:53Z,user_data=None,user_id='1c97d44d1a1a4d3ba6f7e4f7f57dcbee',uuid=f8de1318-fb15-4b5e-9b28-69047b6d48ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11ba77e8-7336-4d39-8527-742d639d4f5a", "address": "fa:16:3e:53:82:95", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba77e8-73", "ovs_interfaceid": "11ba77e8-7336-4d39-8527-742d639d4f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converting VIF {"id": "11ba77e8-7336-4d39-8527-742d639d4f5a", "address": "fa:16:3e:53:82:95", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba77e8-73", "ovs_interfaceid": "11ba77e8-7336-4d39-8527-742d639d4f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:82:95,bridge_name='br-int',has_traffic_filtering=True,id=11ba77e8-7336-4d39-8527-742d639d4f5a,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba77e8-73') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.objects.instance [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lazy-loading 'pci_devices' on Instance uuid f8de1318-fb15-4b5e-9b28-69047b6d48ac {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:24:56 user nova-compute[75102]:   <uuid>f8de1318-fb15-4b5e-9b28-69047b6d48ac</uuid>
Nov 10 16:24:56 user nova-compute[75102]:   <name>instance-00000012</name>
Nov 10 16:24:56 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:24:56 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:24:56 user nova-compute[75102]:   <metadata>
Nov 10 16:24:56 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:24:56 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:name>tempest-VolumesActionsTest-instance-156871188</nova:name>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:24:56</nova:creationTime>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:24:56 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:24:56 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:owner>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:user uuid="1c97d44d1a1a4d3ba6f7e4f7f57dcbee">tempest-VolumesActionsTest-880387838-project-member</nova:user>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:project uuid="2bfa048a64b74cef84d4645eb627c0eb">tempest-VolumesActionsTest-880387838</nova:project>
Nov 10 16:24:56 user nova-compute[75102]:       </nova:owner>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:24:56 user nova-compute[75102]:       <nova:ports>
Nov 10 16:24:56 user nova-compute[75102]:         <nova:port uuid="11ba77e8-7336-4d39-8527-742d639d4f5a">
Nov 10 16:24:56 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 16:24:56 user nova-compute[75102]:         </nova:port>
Nov 10 16:24:56 user nova-compute[75102]:       </nova:ports>
Nov 10 16:24:56 user nova-compute[75102]:     </nova:instance>
Nov 10 16:24:56 user nova-compute[75102]:   </metadata>
Nov 10 16:24:56 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:24:56 user nova-compute[75102]:     <system>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="serial">f8de1318-fb15-4b5e-9b28-69047b6d48ac</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="uuid">f8de1318-fb15-4b5e-9b28-69047b6d48ac</entry>
Nov 10 16:24:56 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:24:56 user nova-compute[75102]:     </system>
Nov 10 16:24:56 user nova-compute[75102]:   </sysinfo>
Nov 10 16:24:56 user nova-compute[75102]:   <os>
Nov 10 16:24:56 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:24:56 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:24:56 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:24:56 user nova-compute[75102]:   </os>
Nov 10 16:24:56 user nova-compute[75102]:   <features>
Nov 10 16:24:56 user nova-compute[75102]:     <acpi/>
Nov 10 16:24:56 user nova-compute[75102]:     <apic/>
Nov 10 16:24:56 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:24:56 user nova-compute[75102]:   </features>
Nov 10 16:24:56 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:24:56 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:24:56 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:24:56 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:24:56 user nova-compute[75102]:   </clock>
Nov 10 16:24:56 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:24:56 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:24:56 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:24:56 user nova-compute[75102]:   </cpu>
Nov 10 16:24:56 user nova-compute[75102]:   <devices>
Nov 10 16:24:56 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:24:56 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:24:56 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk"/>
Nov 10 16:24:56 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:24:56 user nova-compute[75102]:     </disk>
Nov 10 16:24:56 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:24:56 user nova-compute[75102]:       <mac address="fa:16:3e:53:82:95"/>
Nov 10 16:24:56 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:24:56 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:24:56 user nova-compute[75102]:       <target dev="tap11ba77e8-73"/>
Nov 10 16:24:56 user nova-compute[75102]:     </interface>
Nov 10 16:24:56 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:24:56 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/console.log" append="off"/>
Nov 10 16:24:56 user nova-compute[75102]:     </serial>
Nov 10 16:24:56 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:24:56 user nova-compute[75102]:     <video>
Nov 10 16:24:56 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:24:56 user nova-compute[75102]:     </video>
Nov 10 16:24:56 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:24:56 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:24:56 user nova-compute[75102]:     </rng>
Nov 10 16:24:56 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:24:56 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:24:56 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:24:56 user nova-compute[75102]:     </memballoon>
Nov 10 16:24:56 user nova-compute[75102]:   </devices>
Nov 10 16:24:56 user nova-compute[75102]: </domain>
Nov 10 16:24:56 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-156871188',display_name='tempest-VolumesActionsTest-instance-156871188',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-156871188',id=18,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bfa048a64b74cef84d4645eb627c0eb',ramdisk_id='',reservation_id='r-oxriofft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-880387838',owner_user_name='tempest-VolumesActionsTest-880387838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:24:53Z,user_data=None,user_id='1c97d44d1a1a4d3ba6f7e4f7f57dcbee',uuid=f8de1318-fb15-4b5e-9b28-69047b6d48ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "11ba77e8-7336-4d39-8527-742d639d4f5a", "address": "fa:16:3e:53:82:95", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba77e8-73", "ovs_interfaceid": "11ba77e8-7336-4d39-8527-742d639d4f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converting VIF {"id": "11ba77e8-7336-4d39-8527-742d639d4f5a", "address": "fa:16:3e:53:82:95", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba77e8-73", "ovs_interfaceid": "11ba77e8-7336-4d39-8527-742d639d4f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:82:95,bridge_name='br-int',has_traffic_filtering=True,id=11ba77e8-7336-4d39-8527-742d639d4f5a,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba77e8-73') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG os_vif [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:82:95,bridge_name='br-int',has_traffic_filtering=True,id=11ba77e8-7336-4d39-8527-742d639d4f5a,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba77e8-73') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'de772389-1e60-51fd-9f02-b29b2e682be8', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap11ba77e8-73, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap11ba77e8-73, col_values=(('qos', UUID('bb3661ee-a598-4590-9423-43ece2367af4')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap11ba77e8-73, col_values=(('external_ids', {'iface-id': '11ba77e8-7336-4d39-8527-742d639d4f5a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:53:82:95', 'vm-uuid': 'f8de1318-fb15-4b5e-9b28-69047b6d48ac'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:24:56 user nova-compute[75102]: INFO os_vif [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:82:95,bridge_name='br-int',has_traffic_filtering=True,id=11ba77e8-7336-4d39-8527-742d639d4f5a,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba77e8-73')
Nov 10 16:24:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] No VIF found with MAC fa:16:3e:53:82:95, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-1937524b-3418-425f-a1b3-526e97c24ef0 req-6a4f8b20-154a-4a0f-9036-914213550f4f service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received event network-changed-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-1937524b-3418-425f-a1b3-526e97c24ef0 req-6a4f8b20-154a-4a0f-9036-914213550f4f service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Refreshing instance network info cache due to event network-changed-fffa7769-e41a-4fc5-8a45-0ffc65620d64. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1937524b-3418-425f-a1b3-526e97c24ef0 req-6a4f8b20-154a-4a0f-9036-914213550f4f service nova] Acquiring lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1937524b-3418-425f-a1b3-526e97c24ef0 req-6a4f8b20-154a-4a0f-9036-914213550f4f service nova] Acquired lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG nova.network.neutron [req-1937524b-3418-425f-a1b3-526e97c24ef0 req-6a4f8b20-154a-4a0f-9036-914213550f4f service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Refreshing network info cache for port fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.255s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:24:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:24:58 user nova-compute[75102]: DEBUG nova.network.neutron [req-1937524b-3418-425f-a1b3-526e97c24ef0 req-6a4f8b20-154a-4a0f-9036-914213550f4f service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Updated VIF entry in instance network info cache for port fffa7769-e41a-4fc5-8a45-0ffc65620d64. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:24:58 user nova-compute[75102]: DEBUG nova.network.neutron [req-1937524b-3418-425f-a1b3-526e97c24ef0 req-6a4f8b20-154a-4a0f-9036-914213550f4f service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Updating instance_info_cache with network_info: [{"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:24:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1937524b-3418-425f-a1b3-526e97c24ef0 req-6a4f8b20-154a-4a0f-9036-914213550f4f service nova] Releasing lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:24:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-08564717-4a5e-43b7-b5eb-1a34c462b322 req-86353de2-82a0-4e6e-90e8-6c51a60e3bdf service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received event network-vif-plugged-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-08564717-4a5e-43b7-b5eb-1a34c462b322 req-86353de2-82a0-4e6e-90e8-6c51a60e3bdf service nova] Acquiring lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-08564717-4a5e-43b7-b5eb-1a34c462b322 req-86353de2-82a0-4e6e-90e8-6c51a60e3bdf service nova] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-08564717-4a5e-43b7-b5eb-1a34c462b322 req-86353de2-82a0-4e6e-90e8-6c51a60e3bdf service nova] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-08564717-4a5e-43b7-b5eb-1a34c462b322 req-86353de2-82a0-4e6e-90e8-6c51a60e3bdf service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] No waiting events found dispatching network-vif-plugged-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:02 user nova-compute[75102]: WARNING nova.compute.manager [req-08564717-4a5e-43b7-b5eb-1a34c462b322 req-86353de2-82a0-4e6e-90e8-6c51a60e3bdf service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received unexpected event network-vif-plugged-11ba77e8-7336-4d39-8527-742d639d4f5a for instance with vm_state building and task_state spawning.
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-94a01e4b-7f44-4dbb-8dc5-499babf86439 req-58ba6a60-ed02-40c9-afc6-49a30aeea04c service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-94a01e4b-7f44-4dbb-8dc5-499babf86439 req-58ba6a60-ed02-40c9-afc6-49a30aeea04c service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-94a01e4b-7f44-4dbb-8dc5-499babf86439 req-58ba6a60-ed02-40c9-afc6-49a30aeea04c service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-94a01e4b-7f44-4dbb-8dc5-499babf86439 req-58ba6a60-ed02-40c9-afc6-49a30aeea04c service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-94a01e4b-7f44-4dbb-8dc5-499babf86439 req-58ba6a60-ed02-40c9-afc6-49a30aeea04c service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:02 user nova-compute[75102]: WARNING nova.compute.manager [req-94a01e4b-7f44-4dbb-8dc5-499babf86439 req-58ba6a60-ed02-40c9-afc6-49a30aeea04c service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state resized and task_state resize_reverting.
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-980a0d6c-ff61-4729-ba2d-8315fcde9d79 req-a45f542f-71e0-4aef-acb1-a58ed88ee2b5 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received event network-vif-plugged-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-980a0d6c-ff61-4729-ba2d-8315fcde9d79 req-a45f542f-71e0-4aef-acb1-a58ed88ee2b5 service nova] Acquiring lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-980a0d6c-ff61-4729-ba2d-8315fcde9d79 req-a45f542f-71e0-4aef-acb1-a58ed88ee2b5 service nova] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-980a0d6c-ff61-4729-ba2d-8315fcde9d79 req-a45f542f-71e0-4aef-acb1-a58ed88ee2b5 service nova] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-980a0d6c-ff61-4729-ba2d-8315fcde9d79 req-a45f542f-71e0-4aef-acb1-a58ed88ee2b5 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] No waiting events found dispatching network-vif-plugged-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:02 user nova-compute[75102]: WARNING nova.compute.manager [req-980a0d6c-ff61-4729-ba2d-8315fcde9d79 req-a45f542f-71e0-4aef-acb1-a58ed88ee2b5 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received unexpected event network-vif-plugged-11ba77e8-7336-4d39-8527-742d639d4f5a for instance with vm_state building and task_state spawning.
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-df775b97-9fac-4dee-8195-0117bc863f34 req-37595a9f-5aac-41d9-85e6-c56bcda9604e service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-df775b97-9fac-4dee-8195-0117bc863f34 req-37595a9f-5aac-41d9-85e6-c56bcda9604e service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-df775b97-9fac-4dee-8195-0117bc863f34 req-37595a9f-5aac-41d9-85e6-c56bcda9604e service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-df775b97-9fac-4dee-8195-0117bc863f34 req-37595a9f-5aac-41d9-85e6-c56bcda9604e service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-df775b97-9fac-4dee-8195-0117bc863f34 req-37595a9f-5aac-41d9-85e6-c56bcda9604e service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:02 user nova-compute[75102]: WARNING nova.compute.manager [req-df775b97-9fac-4dee-8195-0117bc863f34 req-37595a9f-5aac-41d9-85e6-c56bcda9604e service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state resized and task_state resize_reverting.
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:25:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:03 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Instance spawned successfully.
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:25:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:25:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7777MB free_disk=25.301288604736328GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:03 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance running successfully.
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] finish_revert_migration finished successfully. {{(pid=75102) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:03 user nova-compute[75102]: INFO nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Took 9.91 seconds to spawn the instance on the hypervisor.
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a8562537-34e2-45eb-835c-a4dd59e3af7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 5690a54a-d70d-4342-8838-5ea22588c5ef actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b1ffa0dd-1f28-40f1-83e1-4a677302483c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1d2937fc-16d6-4167-9b43-f0f44663deda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f8de1318-fb15-4b5e-9b28-69047b6d48ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:25:03 user nova-compute[75102]: INFO nova.compute.manager [None req-d0244556-d09b-440e-aeae-fb6593fdb4b1 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance to original state: 'active'
Nov 10 16:25:03 user nova-compute[75102]: INFO nova.compute.manager [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Took 10.92 seconds to build instance.
Nov 10 16:25:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-06e294e4-3fb5-4c3e-a532-7552ea9f16f6 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.084s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:25:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.859s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHKhUSrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:25:04 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:25:04 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:25:04 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee57f33-365a-42a4-8c60-d91daff3e69a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:25:04 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a916f9-b82b-44b3-b9fc-f964aaf1f470]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7] added
Nov 10 16:25:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[78a3aa38-acfc-4981-b5ba-6411b57d764e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[339b1d91-b671-4aea-a4a5-996fd9beb2fb]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHKhUSrT {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vHKhUSrT" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[008d011b-68ec-4343-a5fe-b88332c4555a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vHKhUSrT'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d00892-48f4-4afc-9836-063e46bffdf7]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d82f063-e6a3-4457-b509-4fb11b53de48]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --login" returned: 0 in 0.091s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ee6e9ea-67ce-4b65-bc2b-7389aca28366]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7, portal: 172.16.0.220,3260]
Nov 10 16:25:04 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7, portal: 172.16.0.220,3260] successful.
Nov 10 16:25:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f527a593-0ba4-40a9-8fbb-39cea571fe2e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[90083276-b274-4fe6-9ed1-dd636ab866ab]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.411s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9e2a866-124d-4dac-9104-3b63c8fe809d]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:25:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHKhUSrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updating instance_info_cache with network_info: [{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] <== connect_volume: return (1465ms) {'type': 'block', 'scsi_wwn': '26134353061656134', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26134353061656134', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lazy-loading 'flavor' on Instance uuid e4c81c8e-88f5-4789-8f0a-034965ec6f5e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:25:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:25:05 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:25:05 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:25:05 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:25:05 user nova-compute[75102]:   <serial>9ae787c7-11b1-4864-82d9-c9a9a82404d7</serial>
Nov 10 16:25:05 user nova-compute[75102]: </disk>
Nov 10 16:25:05 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:25:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:25:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:25:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] No VIF found with MAC fa:16:3e:29:7d:ec, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:25:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c4eb16f5-ec42-48f2-b6b0-b8d3ea24c436 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 30.765s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "3f35d18d-c23d-4628-80e7-52e0288fc39e" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:06 user nova-compute[75102]: INFO nova.compute.manager [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Shelving
Nov 10 16:25:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-c7b65362-ec4f-433b-a644-76670fc27746 req-c8c2f49d-2b8f-4d88-88e6-da3715c7dbf8 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received event network-vif-unplugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c7b65362-ec4f-433b-a644-76670fc27746 req-c8c2f49d-2b8f-4d88-88e6-da3715c7dbf8 service nova] Acquiring lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c7b65362-ec4f-433b-a644-76670fc27746 req-c8c2f49d-2b8f-4d88-88e6-da3715c7dbf8 service nova] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c7b65362-ec4f-433b-a644-76670fc27746 req-c8c2f49d-2b8f-4d88-88e6-da3715c7dbf8 service nova] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-c7b65362-ec4f-433b-a644-76670fc27746 req-c8c2f49d-2b8f-4d88-88e6-da3715c7dbf8 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] No waiting events found dispatching network-vif-unplugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:07 user nova-compute[75102]: WARNING nova.compute.manager [req-c7b65362-ec4f-433b-a644-76670fc27746 req-c8c2f49d-2b8f-4d88-88e6-da3715c7dbf8 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received unexpected event network-vif-unplugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 for instance with vm_state active and task_state shelving.
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:07 user nova-compute[75102]: INFO nova.compute.manager [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Terminating instance
Nov 10 16:25:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Instance destroyed successfully.
Nov 10 16:25:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Beginning cold snapshot process
Nov 10 16:25:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:25:08 user nova-compute[75102]: INFO nova.compute.claims [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Claim successful on node user
Nov 10 16:25:08 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk /opt/stack/data/nova/instances/snapshots/tmp2lrpgp5d/4b25cc078794431c94f3e1ad9906f9cb {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:08 user nova-compute[75102]: INFO nova.compute.manager [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Detaching volume 9ae787c7-11b1-4864-82d9-c9a9a82404d7
Nov 10 16:25:08 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Instance destroyed successfully.
Nov 10 16:25:08 user nova-compute[75102]: DEBUG nova.objects.instance [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lazy-loading 'resources' on Instance uuid 5690a54a-d70d-4342-8838-5ea22588c5ef {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:21:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-1386595591',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-1386595591',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-1386595',id=12,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQzKpFMQ9h4E7MZxGawxcejUj+zPAiqhrS55gu6qeIvAWnwp5+sjvfSCnNz6TPy0xfGRmHV0DKURAcV+kwkGjcbS0Btz3rYtbhw6jav/uO8OYhRJWjouu79LY4E5IPqWg==',key_name='tempest-keypair-1817470167',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:21:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1800117728a94e2fab455d8c365f6be5',ramdisk_id='',reservation_id='r-7dbao0jc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-610146322',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:21:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='319edcb7db814fecbf84302d7f9b67c3',uuid=5690a54a-d70d-4342-8838-5ea22588c5ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Converting VIF {"id": "08be21b4-29e4-47eb-a6b9-6453851133d2", "address": "fa:16:3e:77:ad:1c", "network": {"id": "34335d1b-ca66-4cb6-adfc-e3499e9abe46", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-441588808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1800117728a94e2fab455d8c365f6be5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap08be21b4-29", "ovs_interfaceid": "08be21b4-29e4-47eb-a6b9-6453851133d2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:ad:1c,bridge_name='br-int',has_traffic_filtering=True,id=08be21b4-29e4-47eb-a6b9-6453851133d2,network=Network(34335d1b-ca66-4cb6-adfc-e3499e9abe46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be21b4-29') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG os_vif [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:ad:1c,bridge_name='br-int',has_traffic_filtering=True,id=08be21b4-29e4-47eb-a6b9-6453851133d2,network=Network(34335d1b-ca66-4cb6-adfc-e3499e9abe46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be21b4-29') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap08be21b4-29, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99de9c00-ab76-4178-a76b-d56e2679a958) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:09 user nova-compute[75102]: INFO nova.virt.block_device [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Attempting to driver detach volume 9ae787c7-11b1-4864-82d9-c9a9a82404d7 from mountpoint /dev/vdb
Nov 10 16:25:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:09 user nova-compute[75102]: INFO os_vif [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:ad:1c,bridge_name='br-int',has_traffic_filtering=True,id=08be21b4-29e4-47eb-a6b9-6453851133d2,network=Network(34335d1b-ca66-4cb6-adfc-e3499e9abe46),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap08be21b4-29')
Nov 10 16:25:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Deleting instance files /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef_del
Nov 10 16:25:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Deletion of /opt/stack/data/nova/instances/5690a54a-d70d-4342-8838-5ea22588c5ef_del complete
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Attempting to detach device vdb from instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:25:09 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:25:09 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:25:09 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:25:09 user nova-compute[75102]:   <serial>9ae787c7-11b1-4864-82d9-c9a9a82404d7</serial>
Nov 10 16:25:09 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:25:09 user nova-compute[75102]: </disk>
Nov 10 16:25:09 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e/disk /opt/stack/data/nova/instances/snapshots/tmp2lrpgp5d/4b25cc078794431c94f3e1ad9906f9cb" returned: 0 in 0.881s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Snapshot extracted, beginning image upload
Nov 10 16:25:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Successfully detached device vdb from instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e from the persistent domain config.
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:25:09 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:25:09 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:25:09 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:25:09 user nova-compute[75102]:   <serial>9ae787c7-11b1-4864-82d9-c9a9a82404d7</serial>
Nov 10 16:25:09 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:25:09 user nova-compute[75102]: </disk>
Nov 10 16:25:09 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:25:09 user nova-compute[75102]: INFO nova.compute.manager [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.112s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:25:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received event network-vif-plugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] Acquiring lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] No waiting events found dispatching network-vif-plugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:09 user nova-compute[75102]: WARNING nova.compute.manager [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Received unexpected event network-vif-plugged-fffa7769-e41a-4fc5-8a45-0ffc65620d64 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received event network-vif-unplugged-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] No waiting events found dispatching network-vif-unplugged-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received event network-vif-unplugged-08be21b4-29e4-47eb-a6b9-6453851133d2 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received event network-vif-plugged-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] Acquiring lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] No waiting events found dispatching network-vif-plugged-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:09 user nova-compute[75102]: WARNING nova.compute.manager [req-8c19ea53-c13d-465e-b2cf-313b897b7b77 req-40916d28-6f0a-4822-b3c0-b941fa204b88 service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received unexpected event network-vif-plugged-08be21b4-29e4-47eb-a6b9-6453851133d2 for instance with vm_state active and task_state deleting.
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.policy [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e290c40d1bac47f9aa06185efefbb4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e388a924d2546fabfefe82c241ecbb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:25:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Creating image(s)
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "/opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "/opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "/opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.245s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.255s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk 1073741824" returned: 0 in 0.082s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.346s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.298s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Successfully created port: 64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-39a41953-d54f-47ab-9622-fbdf54644ca4 req-37eaebe2-4777-4c86-9756-87f18d625d1c service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Received event network-vif-deleted-08be21b4-29e4-47eb-a6b9-6453851133d2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:10 user nova-compute[75102]: INFO nova.compute.manager [req-39a41953-d54f-47ab-9622-fbdf54644ca4 req-37eaebe2-4777-4c86-9756-87f18d625d1c service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Neutron deleted interface 08be21b4-29e4-47eb-a6b9-6453851133d2; detaching it from the instance and deleting it from the info cache
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-39a41953-d54f-47ab-9622-fbdf54644ca4 req-37eaebe2-4777-4c86-9756-87f18d625d1c service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:10 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Took 1.35 seconds to deallocate network for instance.
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-39a41953-d54f-47ab-9622-fbdf54644ca4 req-37eaebe2-4777-4c86-9756-87f18d625d1c service nova] [instance: 5690a54a-d70d-4342-8838-5ea22588c5ef] Detach interface failed, port_id=08be21b4-29e4-47eb-a6b9-6453851133d2, reason: Instance 5690a54a-d70d-4342-8838-5ea22588c5ef could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Cannot resize image /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Ensure instance console log exists: /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:10 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.486s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:11 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Deleted allocations for instance 5690a54a-d70d-4342-8838-5ea22588c5ef
Nov 10 16:25:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7b42ba3e-c705-484f-92e9-4b0100f16b5d tempest-TestServerVolumeAttachScenarioOldVersion-610146322 tempest-TestServerVolumeAttachScenarioOldVersion-610146322-project-member] Lock "5690a54a-d70d-4342-8838-5ea22588c5ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.689s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Successfully updated port: 64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "refresh_cache-a437e642-d3a4-4356-805e-cb68da21167f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquired lock "refresh_cache-a437e642-d3a4-4356-805e-cb68da21167f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-dfb18f67-1652-4f9d-97ce-86299e1c87f4 req-5c7d624a-2033-4706-8f5e-ca0b2e85bc6d service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received event network-changed-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-dfb18f67-1652-4f9d-97ce-86299e1c87f4 req-5c7d624a-2033-4706-8f5e-ca0b2e85bc6d service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Refreshing instance network info cache due to event network-changed-64f6cf0e-865d-401e-b269-2df0b13d43c2. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dfb18f67-1652-4f9d-97ce-86299e1c87f4 req-5c7d624a-2033-4706-8f5e-ca0b2e85bc6d service nova] Acquiring lock "refresh_cache-a437e642-d3a4-4356-805e-cb68da21167f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Updating instance_info_cache with network_info: [{"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Releasing lock "refresh_cache-a437e642-d3a4-4356-805e-cb68da21167f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Instance network_info: |[{"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dfb18f67-1652-4f9d-97ce-86299e1c87f4 req-5c7d624a-2033-4706-8f5e-ca0b2e85bc6d service nova] Acquired lock "refresh_cache-a437e642-d3a4-4356-805e-cb68da21167f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-dfb18f67-1652-4f9d-97ce-86299e1c87f4 req-5c7d624a-2033-4706-8f5e-ca0b2e85bc6d service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Refreshing network info cache for port 64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Start _get_guest_xml network_info=[{"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:25:11 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:25:11 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-165575473',display_name='tempest-AttachVolumeNegativeTest-server-165575473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-165575473',id=19,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJXrLcbP5wpd2+ApL2z9L/LR8Qx3KUH0k4zbPuCJ0rr65tMh16/zOfgEpVEFy+Ae9n7chLaQGYm//FScX3daKg7ht/TgxCcSI9qKyNVgEuzq2hYfVtMforl+Ylkd7/LbA==',key_name='tempest-keypair-800126954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-0ajehl70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=a437e642-d3a4-4356-805e-cb68da21167f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a7:19,bridge_name='br-int',has_traffic_filtering=True,id=64f6cf0e-865d-401e-b269-2df0b13d43c2,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f6cf0e-86') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.objects.instance [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'pci_devices' on Instance uuid a437e642-d3a4-4356-805e-cb68da21167f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:25:11 user nova-compute[75102]:   <uuid>a437e642-d3a4-4356-805e-cb68da21167f</uuid>
Nov 10 16:25:11 user nova-compute[75102]:   <name>instance-00000013</name>
Nov 10 16:25:11 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:25:11 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:25:11 user nova-compute[75102]:   <metadata>
Nov 10 16:25:11 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:25:11 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:25:11 user nova-compute[75102]:       <nova:name>tempest-AttachVolumeNegativeTest-server-165575473</nova:name>
Nov 10 16:25:11 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:25:11</nova:creationTime>
Nov 10 16:25:11 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:25:11 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:25:11 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:25:11 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:25:11 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:25:11 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:25:11 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:25:11 user nova-compute[75102]:       <nova:owner>
Nov 10 16:25:11 user nova-compute[75102]:         <nova:user uuid="e290c40d1bac47f9aa06185efefbb4bd">tempest-AttachVolumeNegativeTest-1745402198-project-member</nova:user>
Nov 10 16:25:11 user nova-compute[75102]:         <nova:project uuid="6e388a924d2546fabfefe82c241ecbb1">tempest-AttachVolumeNegativeTest-1745402198</nova:project>
Nov 10 16:25:11 user nova-compute[75102]:       </nova:owner>
Nov 10 16:25:11 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:25:11 user nova-compute[75102]:       <nova:ports>
Nov 10 16:25:11 user nova-compute[75102]:         <nova:port uuid="64f6cf0e-865d-401e-b269-2df0b13d43c2">
Nov 10 16:25:11 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 16:25:11 user nova-compute[75102]:         </nova:port>
Nov 10 16:25:11 user nova-compute[75102]:       </nova:ports>
Nov 10 16:25:11 user nova-compute[75102]:     </nova:instance>
Nov 10 16:25:11 user nova-compute[75102]:   </metadata>
Nov 10 16:25:11 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:25:11 user nova-compute[75102]:     <system>
Nov 10 16:25:11 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:25:11 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:25:11 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:25:11 user nova-compute[75102]:       <entry name="serial">a437e642-d3a4-4356-805e-cb68da21167f</entry>
Nov 10 16:25:11 user nova-compute[75102]:       <entry name="uuid">a437e642-d3a4-4356-805e-cb68da21167f</entry>
Nov 10 16:25:11 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:25:11 user nova-compute[75102]:     </system>
Nov 10 16:25:11 user nova-compute[75102]:   </sysinfo>
Nov 10 16:25:11 user nova-compute[75102]:   <os>
Nov 10 16:25:11 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:25:11 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:25:11 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:25:11 user nova-compute[75102]:   </os>
Nov 10 16:25:11 user nova-compute[75102]:   <features>
Nov 10 16:25:11 user nova-compute[75102]:     <acpi/>
Nov 10 16:25:11 user nova-compute[75102]:     <apic/>
Nov 10 16:25:11 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:25:11 user nova-compute[75102]:   </features>
Nov 10 16:25:11 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:25:11 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:25:11 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:25:11 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:25:11 user nova-compute[75102]:   </clock>
Nov 10 16:25:11 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:25:11 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:25:11 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:25:11 user nova-compute[75102]:   </cpu>
Nov 10 16:25:11 user nova-compute[75102]:   <devices>
Nov 10 16:25:11 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:25:11 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:25:11 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk"/>
Nov 10 16:25:11 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:25:11 user nova-compute[75102]:     </disk>
Nov 10 16:25:11 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:25:11 user nova-compute[75102]:       <mac address="fa:16:3e:ab:a7:19"/>
Nov 10 16:25:11 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:25:11 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:25:11 user nova-compute[75102]:       <target dev="tap64f6cf0e-86"/>
Nov 10 16:25:11 user nova-compute[75102]:     </interface>
Nov 10 16:25:11 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:25:11 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/console.log" append="off"/>
Nov 10 16:25:11 user nova-compute[75102]:     </serial>
Nov 10 16:25:11 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:25:11 user nova-compute[75102]:     <video>
Nov 10 16:25:11 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:25:11 user nova-compute[75102]:     </video>
Nov 10 16:25:11 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:25:11 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:25:11 user nova-compute[75102]:     </rng>
Nov 10 16:25:11 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:25:11 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:25:11 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:25:11 user nova-compute[75102]:     </memballoon>
Nov 10 16:25:11 user nova-compute[75102]:   </devices>
Nov 10 16:25:11 user nova-compute[75102]: </domain>
Nov 10 16:25:11 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-165575473',display_name='tempest-AttachVolumeNegativeTest-server-165575473',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-165575473',id=19,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJXrLcbP5wpd2+ApL2z9L/LR8Qx3KUH0k4zbPuCJ0rr65tMh16/zOfgEpVEFy+Ae9n7chLaQGYm//FScX3daKg7ht/TgxCcSI9qKyNVgEuzq2hYfVtMforl+Ylkd7/LbA==',key_name='tempest-keypair-800126954',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-0ajehl70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=a437e642-d3a4-4356-805e-cb68da21167f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a7:19,bridge_name='br-int',has_traffic_filtering=True,id=64f6cf0e-865d-401e-b269-2df0b13d43c2,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f6cf0e-86') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG os_vif [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a7:19,bridge_name='br-int',has_traffic_filtering=True,id=64f6cf0e-865d-401e-b269-2df0b13d43c2,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f6cf0e-86') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '61c4925a-400f-5071-af66-9a5dd068acf9', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap64f6cf0e-86, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap64f6cf0e-86, col_values=(('qos', UUID('9e39b30b-3c09-4b11-8d76-bd031c114cfd')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap64f6cf0e-86, col_values=(('external_ids', {'iface-id': '64f6cf0e-865d-401e-b269-2df0b13d43c2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ab:a7:19', 'vm-uuid': 'a437e642-d3a4-4356-805e-cb68da21167f'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:11 user nova-compute[75102]: INFO os_vif [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ab:a7:19,bridge_name='br-int',has_traffic_filtering=True,id=64f6cf0e-865d-401e-b269-2df0b13d43c2,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f6cf0e-86')
Nov 10 16:25:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:25:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No VIF found with MAC fa:16:3e:ab:a7:19, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:25:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-dfb18f67-1652-4f9d-97ce-86299e1c87f4 req-5c7d624a-2033-4706-8f5e-ca0b2e85bc6d service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Updated VIF entry in instance network info cache for port 64f6cf0e-865d-401e-b269-2df0b13d43c2. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:25:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-dfb18f67-1652-4f9d-97ce-86299e1c87f4 req-5c7d624a-2033-4706-8f5e-ca0b2e85bc6d service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Updating instance_info_cache with network_info: [{"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dfb18f67-1652-4f9d-97ce-86299e1c87f4 req-5c7d624a-2033-4706-8f5e-ca0b2e85bc6d service nova] Releasing lock "refresh_cache-a437e642-d3a4-4356-805e-cb68da21167f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Snapshot image upload complete
Nov 10 16:25:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:25:13 user nova-compute[75102]: INFO nova.compute.manager [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Shelve offloading
Nov 10 16:25:13 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Instance destroyed successfully.
Nov 10 16:25:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:25:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquired lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:13 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:25:13 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Updating instance_info_cache with network_info: [{"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Releasing lock "refresh_cache-3f35d18d-c23d-4628-80e7-52e0288fc39e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-f21b5b5a-afa1-4985-a56d-1244acdbcce0 req-60b857c2-c23a-436e-9317-a010c603f430 service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received event network-vif-plugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f21b5b5a-afa1-4985-a56d-1244acdbcce0 req-60b857c2-c23a-436e-9317-a010c603f430 service nova] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f21b5b5a-afa1-4985-a56d-1244acdbcce0 req-60b857c2-c23a-436e-9317-a010c603f430 service nova] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f21b5b5a-afa1-4985-a56d-1244acdbcce0 req-60b857c2-c23a-436e-9317-a010c603f430 service nova] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-f21b5b5a-afa1-4985-a56d-1244acdbcce0 req-60b857c2-c23a-436e-9317-a010c603f430 service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] No waiting events found dispatching network-vif-plugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:14 user nova-compute[75102]: WARNING nova.compute.manager [req-f21b5b5a-afa1-4985-a56d-1244acdbcce0 req-60b857c2-c23a-436e-9317-a010c603f430 service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received unexpected event network-vif-plugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 for instance with vm_state building and task_state spawning.
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Instance destroyed successfully.
Nov 10 16:25:14 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'resources' on Instance uuid 3f35d18d-c23d-4628-80e7-52e0288fc39e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:23:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-345281466',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-345281466',id=16,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2dptwEhnV8oqQzVTBTHDet0IIps9cVD4gXD7803nOOeE3P1/qJAPcymKGHN/DWmS0DGZR6lv0eYGxvfCreIvwY4U6wiUXue5qoo7/SXIvTZamd+IZZ26usOjf13+zOuQ==',key_name='tempest-keypair-1750720961',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:23:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b656df48b2114d27a9bf9fe6df81037f',ramdisk_id='',reservation_id='r-syolb3ft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1377452369',owner_user_name='tempest-AttachVolumeShelveTestJSON-1377452369-project-member',shelved_at='2023-11-10T16:25:12.952335',shelved_host='user',shelved_image_id='f56e3eb3-79a0-49be-88a1-95b1b0e76a69'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:25:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50787ee821e0400eb445fe8cd891e119',uuid=3f35d18d-c23d-4628-80e7-52e0288fc39e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converting VIF {"id": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "address": "fa:16:3e:6a:1f:a5", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.133", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfffa7769-e4", "ovs_interfaceid": "fffa7769-e41a-4fc5-8a45-0ffc65620d64", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1f:a5,bridge_name='br-int',has_traffic_filtering=True,id=fffa7769-e41a-4fc5-8a45-0ffc65620d64,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfffa7769-e4') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG os_vif [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1f:a5,bridge_name='br-int',has_traffic_filtering=True,id=fffa7769-e41a-4fc5-8a45-0ffc65620d64,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfffa7769-e4') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfffa7769-e4, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e9905c3f-c750-4d5a-92a0-1d8de2013cb7) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:14 user nova-compute[75102]: INFO os_vif [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:1f:a5,bridge_name='br-int',has_traffic_filtering=True,id=fffa7769-e41a-4fc5-8a45-0ffc65620d64,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfffa7769-e4')
Nov 10 16:25:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Deleting instance files /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e_del
Nov 10 16:25:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Deletion of /opt/stack/data/nova/instances/3f35d18d-c23d-4628-80e7-52e0288fc39e_del complete
Nov 10 16:25:14 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Deleted allocations for instance 3f35d18d-c23d-4628-80e7-52e0288fc39e
Nov 10 16:25:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'numa_topology' on Instance uuid 3f35d18d-c23d-4628-80e7-52e0288fc39e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:25:15 user nova-compute[75102]: DEBUG nova.objects.base [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Object Instance<3f35d18d-c23d-4628-80e7-52e0288fc39e> lazy-loaded attributes: resources,numa_topology {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:25:15 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:25:15 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:25:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.494s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a798a265-4fdc-40df-b9e1-aba948744328 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 8.944s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:25:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Instance spawned successfully.
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:16 user nova-compute[75102]: INFO nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Took 6.83 seconds to spawn the instance on the hypervisor.
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-a835fd66-05cf-4f7a-a4b5-c2afccea7163 req-4fda14e1-7073-4d00-8de7-adaf74463b0a service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received event network-vif-plugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a835fd66-05cf-4f7a-a4b5-c2afccea7163 req-4fda14e1-7073-4d00-8de7-adaf74463b0a service nova] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a835fd66-05cf-4f7a-a4b5-c2afccea7163 req-4fda14e1-7073-4d00-8de7-adaf74463b0a service nova] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a835fd66-05cf-4f7a-a4b5-c2afccea7163 req-4fda14e1-7073-4d00-8de7-adaf74463b0a service nova] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-a835fd66-05cf-4f7a-a4b5-c2afccea7163 req-4fda14e1-7073-4d00-8de7-adaf74463b0a service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] No waiting events found dispatching network-vif-plugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:16 user nova-compute[75102]: WARNING nova.compute.manager [req-a835fd66-05cf-4f7a-a4b5-c2afccea7163 req-4fda14e1-7073-4d00-8de7-adaf74463b0a service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received unexpected event network-vif-plugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 for instance with vm_state building and task_state spawning.
Nov 10 16:25:16 user nova-compute[75102]: INFO nova.compute.manager [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Took 8.41 seconds to build instance.
Nov 10 16:25:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0d3d99cb-825e-4251-9282-d0612c689678 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.561s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:25:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:25:18 user nova-compute[75102]: INFO nova.compute.claims [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Claim successful on node user
Nov 10 16:25:18 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:25:18 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:25:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.700s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:25:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:25:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:25:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:25:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG nova.policy [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3149d0620bf64829aa4eec99a2cddee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e926f56f914e7488a50f5bb78a33cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:25:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Creating image(s)
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "/opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "/opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "/opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.231s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.191s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk 1073741824" returned: 0 in 0.066s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.270s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Successfully created port: aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.223s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:25:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Cannot resize image /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Ensure instance console log exists: /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Successfully updated port: aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "refresh_cache-b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquired lock "refresh_cache-b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-65b0a81d-26fd-47d6-a769-ad55ff14bdfa req-8feeceb6-2a1c-404c-88e0-00c459451139 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-changed-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-65b0a81d-26fd-47d6-a769-ad55ff14bdfa req-8feeceb6-2a1c-404c-88e0-00c459451139 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Refreshing instance network info cache due to event network-changed-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-65b0a81d-26fd-47d6-a769-ad55ff14bdfa req-8feeceb6-2a1c-404c-88e0-00c459451139 service nova] Acquiring lock "refresh_cache-b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:25:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Updating instance_info_cache with network_info: [{"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Releasing lock "refresh_cache-b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Instance network_info: |[{"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-65b0a81d-26fd-47d6-a769-ad55ff14bdfa req-8feeceb6-2a1c-404c-88e0-00c459451139 service nova] Acquired lock "refresh_cache-b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-65b0a81d-26fd-47d6-a769-ad55ff14bdfa req-8feeceb6-2a1c-404c-88e0-00c459451139 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Refreshing network info cache for port aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Start _get_guest_xml network_info=[{"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:25:21 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:25:21 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-110130726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-110130726',id=20,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-rxk0c7zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:25:19Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=b0b033f4-4325-4d53-bd0d-1c90bbfa54cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:32:e8,bridge_name='br-int',has_traffic_filtering=True,id=aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa348bf6-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'pci_devices' on Instance uuid b0b033f4-4325-4d53-bd0d-1c90bbfa54cc {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:25:21 user nova-compute[75102]:   <uuid>b0b033f4-4325-4d53-bd0d-1c90bbfa54cc</uuid>
Nov 10 16:25:21 user nova-compute[75102]:   <name>instance-00000014</name>
Nov 10 16:25:21 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:25:21 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:25:21 user nova-compute[75102]:   <metadata>
Nov 10 16:25:21 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:25:21 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:25:21 user nova-compute[75102]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-110130726</nova:name>
Nov 10 16:25:21 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:25:21</nova:creationTime>
Nov 10 16:25:21 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:25:21 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:25:21 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:25:21 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:25:21 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:25:21 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:25:21 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:25:21 user nova-compute[75102]:       <nova:owner>
Nov 10 16:25:21 user nova-compute[75102]:         <nova:user uuid="3149d0620bf64829aa4eec99a2cddee5">tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member</nova:user>
Nov 10 16:25:21 user nova-compute[75102]:         <nova:project uuid="c0e926f56f914e7488a50f5bb78a33cd">tempest-ServerBootFromVolumeStableRescueTest-918868864</nova:project>
Nov 10 16:25:21 user nova-compute[75102]:       </nova:owner>
Nov 10 16:25:21 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:25:21 user nova-compute[75102]:       <nova:ports>
Nov 10 16:25:21 user nova-compute[75102]:         <nova:port uuid="aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b">
Nov 10 16:25:21 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 16:25:21 user nova-compute[75102]:         </nova:port>
Nov 10 16:25:21 user nova-compute[75102]:       </nova:ports>
Nov 10 16:25:21 user nova-compute[75102]:     </nova:instance>
Nov 10 16:25:21 user nova-compute[75102]:   </metadata>
Nov 10 16:25:21 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:25:21 user nova-compute[75102]:     <system>
Nov 10 16:25:21 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:25:21 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:25:21 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:25:21 user nova-compute[75102]:       <entry name="serial">b0b033f4-4325-4d53-bd0d-1c90bbfa54cc</entry>
Nov 10 16:25:21 user nova-compute[75102]:       <entry name="uuid">b0b033f4-4325-4d53-bd0d-1c90bbfa54cc</entry>
Nov 10 16:25:21 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:25:21 user nova-compute[75102]:     </system>
Nov 10 16:25:21 user nova-compute[75102]:   </sysinfo>
Nov 10 16:25:21 user nova-compute[75102]:   <os>
Nov 10 16:25:21 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:25:21 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:25:21 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:25:21 user nova-compute[75102]:   </os>
Nov 10 16:25:21 user nova-compute[75102]:   <features>
Nov 10 16:25:21 user nova-compute[75102]:     <acpi/>
Nov 10 16:25:21 user nova-compute[75102]:     <apic/>
Nov 10 16:25:21 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:25:21 user nova-compute[75102]:   </features>
Nov 10 16:25:21 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:25:21 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:25:21 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:25:21 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:25:21 user nova-compute[75102]:   </clock>
Nov 10 16:25:21 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:25:21 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:25:21 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:25:21 user nova-compute[75102]:   </cpu>
Nov 10 16:25:21 user nova-compute[75102]:   <devices>
Nov 10 16:25:21 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:25:21 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:25:21 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk"/>
Nov 10 16:25:21 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:25:21 user nova-compute[75102]:     </disk>
Nov 10 16:25:21 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:25:21 user nova-compute[75102]:       <mac address="fa:16:3e:ba:32:e8"/>
Nov 10 16:25:21 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:25:21 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:25:21 user nova-compute[75102]:       <target dev="tapaa348bf6-ca"/>
Nov 10 16:25:21 user nova-compute[75102]:     </interface>
Nov 10 16:25:21 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:25:21 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/console.log" append="off"/>
Nov 10 16:25:21 user nova-compute[75102]:     </serial>
Nov 10 16:25:21 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:25:21 user nova-compute[75102]:     <video>
Nov 10 16:25:21 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:25:21 user nova-compute[75102]:     </video>
Nov 10 16:25:21 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:25:21 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:25:21 user nova-compute[75102]:     </rng>
Nov 10 16:25:21 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:25:21 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:25:21 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:25:21 user nova-compute[75102]:     </memballoon>
Nov 10 16:25:21 user nova-compute[75102]:   </devices>
Nov 10 16:25:21 user nova-compute[75102]: </domain>
Nov 10 16:25:21 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-110130726',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-110130726',id=20,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-rxk0c7zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:25:19Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=b0b033f4-4325-4d53-bd0d-1c90bbfa54cc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ba:32:e8,bridge_name='br-int',has_traffic_filtering=True,id=aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa348bf6-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG os_vif [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:32:e8,bridge_name='br-int',has_traffic_filtering=True,id=aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa348bf6-ca') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '02ed89d2-0e9e-58db-a7d9-12c894135748', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaa348bf6-ca, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaa348bf6-ca, col_values=(('qos', UUID('3efd8c56-0db5-4d8b-9eac-1a3d0e9ef2e0')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaa348bf6-ca, col_values=(('external_ids', {'iface-id': 'aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ba:32:e8', 'vm-uuid': 'b0b033f4-4325-4d53-bd0d-1c90bbfa54cc'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:21 user nova-compute[75102]: INFO os_vif [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ba:32:e8,bridge_name='br-int',has_traffic_filtering=True,id=aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa348bf6-ca')
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No VIF found with MAC fa:16:3e:ba:32:e8, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-65b0a81d-26fd-47d6-a769-ad55ff14bdfa req-8feeceb6-2a1c-404c-88e0-00c459451139 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Updated VIF entry in instance network info cache for port aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-65b0a81d-26fd-47d6-a769-ad55ff14bdfa req-8feeceb6-2a1c-404c-88e0-00c459451139 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Updating instance_info_cache with network_info: [{"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-65b0a81d-26fd-47d6-a769-ad55ff14bdfa req-8feeceb6-2a1c-404c-88e0-00c459451139 service nova] Releasing lock "refresh_cache-b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-2fadc369-9b5c-4257-bf77-b924857d1789 req-7245c97d-56c4-47cd-95cb-143ad465c17b service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2fadc369-9b5c-4257-bf77-b924857d1789 req-7245c97d-56c4-47cd-95cb-143ad465c17b service nova] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2fadc369-9b5c-4257-bf77-b924857d1789 req-7245c97d-56c4-47cd-95cb-143ad465c17b service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2fadc369-9b5c-4257-bf77-b924857d1789 req-7245c97d-56c4-47cd-95cb-143ad465c17b service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-2fadc369-9b5c-4257-bf77-b924857d1789 req-7245c97d-56c4-47cd-95cb-143ad465c17b service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] No waiting events found dispatching network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:22 user nova-compute[75102]: WARNING nova.compute.manager [req-2fadc369-9b5c-4257-bf77-b924857d1789 req-7245c97d-56c4-47cd-95cb-143ad465c17b service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received unexpected event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b for instance with vm_state building and task_state spawning.
Nov 10 16:25:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-af283ca5-06fc-482b-b8a3-c241800b20a6 req-f4bf9487-bb38-4926-a74d-5942bd9faff7 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-af283ca5-06fc-482b-b8a3-c241800b20a6 req-f4bf9487-bb38-4926-a74d-5942bd9faff7 service nova] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-af283ca5-06fc-482b-b8a3-c241800b20a6 req-f4bf9487-bb38-4926-a74d-5942bd9faff7 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-af283ca5-06fc-482b-b8a3-c241800b20a6 req-f4bf9487-bb38-4926-a74d-5942bd9faff7 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-af283ca5-06fc-482b-b8a3-c241800b20a6 req-f4bf9487-bb38-4926-a74d-5942bd9faff7 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] No waiting events found dispatching network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:25 user nova-compute[75102]: WARNING nova.compute.manager [req-af283ca5-06fc-482b-b8a3-c241800b20a6 req-f4bf9487-bb38-4926-a74d-5942bd9faff7 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received unexpected event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b for instance with vm_state building and task_state spawning.
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:25:25 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Instance spawned successfully.
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:25:25 user nova-compute[75102]: INFO nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 10 16:25:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:25:25 user nova-compute[75102]: INFO nova.compute.manager [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Took 7.46 seconds to build instance.
Nov 10 16:25:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c3da71e5-6c9d-435b-80ee-2d1e550bdc23 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.582s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHDafhiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:25:27 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:25:27 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:25:27 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d6ca92-5665-4134-a198-46fa463df6fc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:25:27 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63a90c3-e830-4f8d-8a5d-771cefcbae9c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881] added
Nov 10 16:25:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ee012b-e133-4c44-bacf-6ea3d7685211]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5567d07d-d588-44a5-a2a4-6bfeef0aecb8]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHDafhiX {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHDafhiX" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[538ae3bb-c21f-4d3c-a30e-bf2da26a20d9]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZHDafhiX'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb47fcae-26f5-45fb-860b-66f14c1012da]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56fb569-57a9-4e7b-bea4-7be04f67c070]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b9ee7d7-7e77-44d4-a7e6-d5c2058331c8]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260]
Nov 10 16:25:27 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260] successful.
Nov 10 16:25:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7835492f-78cd-4282-87b5-7309b327dcd3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb39e61a-91bb-450c-a29b-f530422fde94]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] HCTL ('36', '-', '-', 0) found on session 19 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.049s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab46021-5767-4369-b9ea-0a6d076c89b4]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Searching for a device in session 19 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:25:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHDafhiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:25:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.400s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:25:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] <== connect_volume: return (1401ms) {'type': 'block', 'scsi_wwn': '26466366634373539', 'path': '/dev/sde'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:25:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466366634373539', 'path': '/dev/sde'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:25:28 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'flavor' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:25:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:25:28 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:25:28 user nova-compute[75102]:   <source dev="/dev/sde"/>
Nov 10 16:25:28 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:25:28 user nova-compute[75102]:   <serial>47a37063-5d3a-443d-a66d-331b3fc1b881</serial>
Nov 10 16:25:28 user nova-compute[75102]: </disk>
Nov 10 16:25:28 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No VIF found with MAC fa:16:3e:d3:d8:7a, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:25:29 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e is timed out.
Nov 10 16:25:29 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Successfully detached device vdb from instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e from the live domain config.
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d2e0fb5c-4421-4aa7-a3a8-cc26ca500f43 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 33.618s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vHKhUSrT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:25:29 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.004s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a1bc68-5258-4011-97a6-0032eec7d77a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:25:29 user nova-compute[75102]: No targets found.
Nov 10 16:25:29 user nova-compute[75102]: iSNS:
Nov 10 16:25:29 user nova-compute[75102]: No targets found.
Nov 10 16:25:29 user nova-compute[75102]: STATIC:
Nov 10 16:25:29 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881
Nov 10 16:25:29 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:25:29 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:25:29 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:25:29 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:25:29 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:25:29 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788
Nov 10 16:25:29 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:25:29 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:25:29 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7
Nov 10 16:25:29 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:25:29 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:25:29 user nova-compute[75102]: FIRMWARE:
Nov 10 16:25:29 user nova-compute[75102]: No targets found.
Nov 10 16:25:29 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:25:29 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:25:29 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[316339a1-8116-4da8-81c0-0fdeb64001e8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae92d853-f1fc-4e81-b83d-5e5df6372b18]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:29 user nova-compute[75102]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)
Nov 10 16:25:29 user nova-compute[75102]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:25:29 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:29 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:25:29 user nova-compute[75102]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 (non-flash)
Nov 10 16:25:29 user nova-compute[75102]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:25:29 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:25:29 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74474e50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fbce779-b6bc-4012-95a0-ae51477ff47d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19212a9-d3ba-4499-a2b6-71c7f671187a]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c521c2-8947-4dbb-b1a7-c81c22cce34d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:25:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.058s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d9dbd0-8d3a-4864-9a21-6b221a85f339]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7a2188e-2322-4020-8d48-6bb6f7cdc577]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb775fc-abfc-4823-9071-dfc9397217a2]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7, portal: 172.16.0.220,3260]
Nov 10 16:25:30 user nova-compute[75102]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7, portal: 172.16.0.220,3260] successful.
Nov 10 16:25:30 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:9ae787c7-11b1-4864-82d9-c9a9a82404d7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d107fe-2a75-4f92-b927-3820e17a0b81]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] <== disconnect_volume: return (429ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:25:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:25:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:31 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lazy-loading 'flavor' on Instance uuid e4c81c8e-88f5-4789-8f0a-034965ec6f5e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:25:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f711c940-e56f-42bb-8c4d-32e3bd0e068b tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.950s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-da27fbfc-c239-4b46-96b2-d20443060697 req-b6c90487-7c66-4621-b9b1-68c401956968 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-da27fbfc-c239-4b46-96b2-d20443060697 req-b6c90487-7c66-4621-b9b1-68c401956968 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing instance network info cache due to event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:25:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-da27fbfc-c239-4b46-96b2-d20443060697 req-b6c90487-7c66-4621-b9b1-68c401956968 service nova] Acquiring lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-da27fbfc-c239-4b46-96b2-d20443060697 req-b6c90487-7c66-4621-b9b1-68c401956968 service nova] Acquired lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:45 user nova-compute[75102]: DEBUG nova.network.neutron [req-da27fbfc-c239-4b46-96b2-d20443060697 req-b6c90487-7c66-4621-b9b1-68c401956968 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:25:46 user nova-compute[75102]: DEBUG nova.network.neutron [req-da27fbfc-c239-4b46-96b2-d20443060697 req-b6c90487-7c66-4621-b9b1-68c401956968 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updated VIF entry in instance network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:25:46 user nova-compute[75102]: DEBUG nova.network.neutron [req-da27fbfc-c239-4b46-96b2-d20443060697 req-b6c90487-7c66-4621-b9b1-68c401956968 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updating instance_info_cache with network_info: [{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-da27fbfc-c239-4b46-96b2-d20443060697 req-b6c90487-7c66-4621-b9b1-68c401956968 service nova] Releasing lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:48 user nova-compute[75102]: DEBUG nova.compute.manager [req-ff30e5cb-cfab-4dcf-aa97-028482a68bbc req-c8b72535-ff42-4562-8b73-5a7dbde7727a service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:48 user nova-compute[75102]: DEBUG nova.compute.manager [req-ff30e5cb-cfab-4dcf-aa97-028482a68bbc req-c8b72535-ff42-4562-8b73-5a7dbde7727a service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing instance network info cache due to event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:25:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ff30e5cb-cfab-4dcf-aa97-028482a68bbc req-c8b72535-ff42-4562-8b73-5a7dbde7727a service nova] Acquiring lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ff30e5cb-cfab-4dcf-aa97-028482a68bbc req-c8b72535-ff42-4562-8b73-5a7dbde7727a service nova] Acquired lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:48 user nova-compute[75102]: DEBUG nova.network.neutron [req-ff30e5cb-cfab-4dcf-aa97-028482a68bbc req-c8b72535-ff42-4562-8b73-5a7dbde7727a service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:25:49 user nova-compute[75102]: DEBUG nova.network.neutron [req-ff30e5cb-cfab-4dcf-aa97-028482a68bbc req-c8b72535-ff42-4562-8b73-5a7dbde7727a service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updated VIF entry in instance network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:25:49 user nova-compute[75102]: DEBUG nova.network.neutron [req-ff30e5cb-cfab-4dcf-aa97-028482a68bbc req-c8b72535-ff42-4562-8b73-5a7dbde7727a service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updating instance_info_cache with network_info: [{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ff30e5cb-cfab-4dcf-aa97-028482a68bbc req-c8b72535-ff42-4562-8b73-5a7dbde7727a service nova] Releasing lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:51 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:53 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:25:55 user nova-compute[75102]: INFO nova.compute.claims [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Claim successful on node user
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Updating instance_info_cache with network_info: [{"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-a8562537-34e2-45eb-835c-a4dd59e3af7c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:25:56 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.policy [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bbea9eecf0b4e998ad458bc0d30a5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5704b433744dd8188e61d576dd461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:25:56 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Creating image(s)
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "/opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "/opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "/opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.263s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG nova.network.neutron [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Successfully created port: 9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk 1073741824" returned: 0 in 0.057s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Cannot resize image /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Ensure instance console log exists: /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:25:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Successfully updated port: 9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquired lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-e1aaa85c-95f6-4f0e-9fc8-6f6348be0f22 req-ff3a23db-afbc-48a1-ab70-60e6d9cfed13 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Received event network-changed-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-e1aaa85c-95f6-4f0e-9fc8-6f6348be0f22 req-ff3a23db-afbc-48a1-ab70-60e6d9cfed13 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Refreshing instance network info cache due to event network-changed-9cb73dcc-ebbc-40a9-8375-49e8fd739c07. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e1aaa85c-95f6-4f0e-9fc8-6f6348be0f22 req-ff3a23db-afbc-48a1-ab70-60e6d9cfed13 service nova] Acquiring lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updating instance_info_cache with network_info: [{"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Releasing lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Instance network_info: |[{"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e1aaa85c-95f6-4f0e-9fc8-6f6348be0f22 req-ff3a23db-afbc-48a1-ab70-60e6d9cfed13 service nova] Acquired lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.neutron [req-e1aaa85c-95f6-4f0e-9fc8-6f6348be0f22 req-ff3a23db-afbc-48a1-ab70-60e6d9cfed13 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Refreshing network info cache for port 9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Start _get_guest_xml network_info=[{"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:25:58 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:25:58 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-726645659',display_name='tempest-ServerActionsTestOtherA-server-726645659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-726645659',id=21,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJIyuW1YgII5m42ZzPQI/sKQHH3q65mUxP8WzQFSf/4n/JTQ1Wu3opROEkHOGysy1Wt2WY0dRoS8kKXFZZja/7C79VSuXQ0L9aJFgTEonW/PDJXKdDwWpg0JM1ZatQvbg==',key_name='tempest-keypair-394571970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-naw2lfj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:25:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:dd:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb73dcc-ebbc-40a9-8375-49e8fd739c07,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb73dcc-eb') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.objects.instance [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'pci_devices' on Instance uuid 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:25:58 user nova-compute[75102]:   <uuid>82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e</uuid>
Nov 10 16:25:58 user nova-compute[75102]:   <name>instance-00000015</name>
Nov 10 16:25:58 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:25:58 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:25:58 user nova-compute[75102]:   <metadata>
Nov 10 16:25:58 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:25:58 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:25:58 user nova-compute[75102]:       <nova:name>tempest-ServerActionsTestOtherA-server-726645659</nova:name>
Nov 10 16:25:58 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:25:58</nova:creationTime>
Nov 10 16:25:58 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:25:58 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:25:58 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:25:58 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:25:58 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:25:58 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:25:58 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:25:58 user nova-compute[75102]:       <nova:owner>
Nov 10 16:25:58 user nova-compute[75102]:         <nova:user uuid="7bbea9eecf0b4e998ad458bc0d30a5bf">tempest-ServerActionsTestOtherA-1931720116-project-member</nova:user>
Nov 10 16:25:58 user nova-compute[75102]:         <nova:project uuid="46f5704b433744dd8188e61d576dd461">tempest-ServerActionsTestOtherA-1931720116</nova:project>
Nov 10 16:25:58 user nova-compute[75102]:       </nova:owner>
Nov 10 16:25:58 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:25:58 user nova-compute[75102]:       <nova:ports>
Nov 10 16:25:58 user nova-compute[75102]:         <nova:port uuid="9cb73dcc-ebbc-40a9-8375-49e8fd739c07">
Nov 10 16:25:58 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 16:25:58 user nova-compute[75102]:         </nova:port>
Nov 10 16:25:58 user nova-compute[75102]:       </nova:ports>
Nov 10 16:25:58 user nova-compute[75102]:     </nova:instance>
Nov 10 16:25:58 user nova-compute[75102]:   </metadata>
Nov 10 16:25:58 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:25:58 user nova-compute[75102]:     <system>
Nov 10 16:25:58 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:25:58 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:25:58 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:25:58 user nova-compute[75102]:       <entry name="serial">82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e</entry>
Nov 10 16:25:58 user nova-compute[75102]:       <entry name="uuid">82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e</entry>
Nov 10 16:25:58 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:25:58 user nova-compute[75102]:     </system>
Nov 10 16:25:58 user nova-compute[75102]:   </sysinfo>
Nov 10 16:25:58 user nova-compute[75102]:   <os>
Nov 10 16:25:58 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:25:58 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:25:58 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:25:58 user nova-compute[75102]:   </os>
Nov 10 16:25:58 user nova-compute[75102]:   <features>
Nov 10 16:25:58 user nova-compute[75102]:     <acpi/>
Nov 10 16:25:58 user nova-compute[75102]:     <apic/>
Nov 10 16:25:58 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:25:58 user nova-compute[75102]:   </features>
Nov 10 16:25:58 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:25:58 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:25:58 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:25:58 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:25:58 user nova-compute[75102]:   </clock>
Nov 10 16:25:58 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:25:58 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:25:58 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:25:58 user nova-compute[75102]:   </cpu>
Nov 10 16:25:58 user nova-compute[75102]:   <devices>
Nov 10 16:25:58 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:25:58 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:25:58 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk"/>
Nov 10 16:25:58 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:25:58 user nova-compute[75102]:     </disk>
Nov 10 16:25:58 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:25:58 user nova-compute[75102]:       <mac address="fa:16:3e:7d:dd:57"/>
Nov 10 16:25:58 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:25:58 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:25:58 user nova-compute[75102]:       <target dev="tap9cb73dcc-eb"/>
Nov 10 16:25:58 user nova-compute[75102]:     </interface>
Nov 10 16:25:58 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:25:58 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/console.log" append="off"/>
Nov 10 16:25:58 user nova-compute[75102]:     </serial>
Nov 10 16:25:58 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:25:58 user nova-compute[75102]:     <video>
Nov 10 16:25:58 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:25:58 user nova-compute[75102]:     </video>
Nov 10 16:25:58 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:25:58 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:25:58 user nova-compute[75102]:     </rng>
Nov 10 16:25:58 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:25:58 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:25:58 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:25:58 user nova-compute[75102]:     </memballoon>
Nov 10 16:25:58 user nova-compute[75102]:   </devices>
Nov 10 16:25:58 user nova-compute[75102]: </domain>
Nov 10 16:25:58 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-726645659',display_name='tempest-ServerActionsTestOtherA-server-726645659',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-726645659',id=21,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJIyuW1YgII5m42ZzPQI/sKQHH3q65mUxP8WzQFSf/4n/JTQ1Wu3opROEkHOGysy1Wt2WY0dRoS8kKXFZZja/7C79VSuXQ0L9aJFgTEonW/PDJXKdDwWpg0JM1ZatQvbg==',key_name='tempest-keypair-394571970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-naw2lfj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:25:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7d:dd:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb73dcc-ebbc-40a9-8375-49e8fd739c07,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb73dcc-eb') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG os_vif [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:dd:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb73dcc-ebbc-40a9-8375-49e8fd739c07,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb73dcc-eb') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd71770da-3c8b-562b-9e28-3f6a2ba51bfc', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9cb73dcc-eb, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9cb73dcc-eb, col_values=(('qos', UUID('2814e1ba-effe-4aea-96d4-98f1fa21e208')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9cb73dcc-eb, col_values=(('external_ids', {'iface-id': '9cb73dcc-ebbc-40a9-8375-49e8fd739c07', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7d:dd:57', 'vm-uuid': '82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:58 user nova-compute[75102]: INFO os_vif [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7d:dd:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb73dcc-ebbc-40a9-8375-49e8fd739c07,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb73dcc-eb')
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No VIF found with MAC fa:16:3e:7d:dd:57, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.neutron [req-e1aaa85c-95f6-4f0e-9fc8-6f6348be0f22 req-ff3a23db-afbc-48a1-ab70-60e6d9cfed13 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updated VIF entry in instance network info cache for port 9cb73dcc-ebbc-40a9-8375-49e8fd739c07. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG nova.network.neutron [req-e1aaa85c-95f6-4f0e-9fc8-6f6348be0f22 req-ff3a23db-afbc-48a1-ab70-60e6d9cfed13 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updating instance_info_cache with network_info: [{"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:25:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e1aaa85c-95f6-4f0e-9fc8-6f6348be0f22 req-ff3a23db-afbc-48a1-ab70-60e6d9cfed13 service nova] Releasing lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:59 user nova-compute[75102]: INFO nova.compute.manager [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Terminating instance
Nov 10 16:25:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-a0447615-c31a-4dc8-938d-84b91a235256 req-89608f6a-c1d3-418d-accf-490b1594fc23 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received event network-vif-unplugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a0447615-c31a-4dc8-938d-84b91a235256 req-89608f6a-c1d3-418d-accf-490b1594fc23 service nova] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a0447615-c31a-4dc8-938d-84b91a235256 req-89608f6a-c1d3-418d-accf-490b1594fc23 service nova] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a0447615-c31a-4dc8-938d-84b91a235256 req-89608f6a-c1d3-418d-accf-490b1594fc23 service nova] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-a0447615-c31a-4dc8-938d-84b91a235256 req-89608f6a-c1d3-418d-accf-490b1594fc23 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] No waiting events found dispatching network-vif-unplugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-a0447615-c31a-4dc8-938d-84b91a235256 req-89608f6a-c1d3-418d-accf-490b1594fc23 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received event network-vif-unplugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:25:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "4a45616a-3df0-45b0-8271-881c49140a0a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "4a45616a-3df0-45b0-8271-881c49140a0a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:00 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Instance destroyed successfully.
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.objects.instance [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'resources' on Instance uuid a8562537-34e2-45eb-835c-a4dd59e3af7c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:26:00 user nova-compute[75102]: INFO nova.compute.claims [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Claim successful on node user
Nov 10 16:26:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:20:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628681901',display_name='tempest-AttachVolumeTestJSON-server-1628681901',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628681901',id=11,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAOzhYwARGmPnCAHQDJ07hSoBoKeoFloAP8BhLbfxMfb6sWEIlcFO1RXTqP2h1BHkDvNmjRB7M3l+o5n3w3nq4ej0zNo/bOHuPMw8rt+UxzA+FRn9gpytId1gJhViL+mQg==',key_name='tempest-keypair-332246158',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:20:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d408293bc34453b58b852baca77d35',ramdisk_id='',reservation_id='r-v941j3bx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1946940767',owner_user_name='tempest-AttachVolumeTestJSON-1946940767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:20:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95ef5e9028c34d61b880bff813a53216',uuid=a8562537-34e2-45eb-835c-a4dd59e3af7c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converting VIF {"id": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "address": "fa:16:3e:4f:f9:bb", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.241", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd798edb0-43", "ovs_interfaceid": "d798edb0-43db-4e57-a080-2ea4db4bd5a3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f9:bb,bridge_name='br-int',has_traffic_filtering=True,id=d798edb0-43db-4e57-a080-2ea4db4bd5a3,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd798edb0-43') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG os_vif [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f9:bb,bridge_name='br-int',has_traffic_filtering=True,id=d798edb0-43db-4e57-a080-2ea4db4bd5a3,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd798edb0-43') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd798edb0-43, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=33ba90bb-c180-45eb-821b-939edf2a1345) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:00 user nova-compute[75102]: INFO os_vif [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:f9:bb,bridge_name='br-int',has_traffic_filtering=True,id=d798edb0-43db-4e57-a080-2ea4db4bd5a3,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd798edb0-43')
Nov 10 16:26:00 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Deleting instance files /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c_del
Nov 10 16:26:00 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Deletion of /opt/stack/data/nova/instances/a8562537-34e2-45eb-835c-a4dd59e3af7c_del complete
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:00 user nova-compute[75102]: INFO nova.compute.manager [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Took 1.62 seconds to destroy the instance on the hypervisor.
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-e0528f6f-1c01-4bac-af3e-aea1202f246d req-4c5b0ea8-25dd-4b94-86a9-7c6a9ebf1af3 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Received event network-vif-plugged-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e0528f6f-1c01-4bac-af3e-aea1202f246d req-4c5b0ea8-25dd-4b94-86a9-7c6a9ebf1af3 service nova] Acquiring lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e0528f6f-1c01-4bac-af3e-aea1202f246d req-4c5b0ea8-25dd-4b94-86a9-7c6a9ebf1af3 service nova] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e0528f6f-1c01-4bac-af3e-aea1202f246d req-4c5b0ea8-25dd-4b94-86a9-7c6a9ebf1af3 service nova] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-e0528f6f-1c01-4bac-af3e-aea1202f246d req-4c5b0ea8-25dd-4b94-86a9-7c6a9ebf1af3 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] No waiting events found dispatching network-vif-plugged-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:00 user nova-compute[75102]: WARNING nova.compute.manager [req-e0528f6f-1c01-4bac-af3e-aea1202f246d req-4c5b0ea8-25dd-4b94-86a9-7c6a9ebf1af3 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Received unexpected event network-vif-plugged-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 for instance with vm_state building and task_state spawning.
Nov 10 16:26:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.263s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-05baddb1-1372-4c85-bc8f-a069c2497540 req-f9fc2cb1-6cd3-4a63-a917-1d01c6823708 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received event network-vif-plugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-05baddb1-1372-4c85-bc8f-a069c2497540 req-f9fc2cb1-6cd3-4a63-a917-1d01c6823708 service nova] Acquiring lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-05baddb1-1372-4c85-bc8f-a069c2497540 req-f9fc2cb1-6cd3-4a63-a917-1d01c6823708 service nova] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-05baddb1-1372-4c85-bc8f-a069c2497540 req-f9fc2cb1-6cd3-4a63-a917-1d01c6823708 service nova] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-05baddb1-1372-4c85-bc8f-a069c2497540 req-f9fc2cb1-6cd3-4a63-a917-1d01c6823708 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] No waiting events found dispatching network-vif-plugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:03 user nova-compute[75102]: WARNING nova.compute.manager [req-05baddb1-1372-4c85-bc8f-a069c2497540 req-f9fc2cb1-6cd3-4a63-a917-1d01c6823708 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received unexpected event network-vif-plugged-d798edb0-43db-4e57-a080-2ea4db4bd5a3 for instance with vm_state active and task_state deleting.
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-a43592e0-214b-4546-84a2-1060c1ec1b09 req-95f1e171-4be3-42fe-90a9-09d24fe6d6d6 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Received event network-vif-plugged-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a43592e0-214b-4546-84a2-1060c1ec1b09 req-95f1e171-4be3-42fe-90a9-09d24fe6d6d6 service nova] Acquiring lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a43592e0-214b-4546-84a2-1060c1ec1b09 req-95f1e171-4be3-42fe-90a9-09d24fe6d6d6 service nova] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a43592e0-214b-4546-84a2-1060c1ec1b09 req-95f1e171-4be3-42fe-90a9-09d24fe6d6d6 service nova] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-a43592e0-214b-4546-84a2-1060c1ec1b09 req-95f1e171-4be3-42fe-90a9-09d24fe6d6d6 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] No waiting events found dispatching network-vif-plugged-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:03 user nova-compute[75102]: WARNING nova.compute.manager [req-a43592e0-214b-4546-84a2-1060c1ec1b09 req-95f1e171-4be3-42fe-90a9-09d24fe6d6d6 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Received unexpected event network-vif-plugged-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 for instance with vm_state building and task_state spawning.
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:26:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:26:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7412MB free_disk=25.207923889160156GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:03 user nova-compute[75102]: INFO nova.compute.manager [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Rebooting instance
Nov 10 16:26:03 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Instance spawned successfully.
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquired lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:26:03 user nova-compute[75102]: INFO nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Took 6.87 seconds to spawn the instance on the hypervisor.
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:26:03 user nova-compute[75102]: INFO nova.compute.manager [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Took 7.79 seconds to build instance.
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.079s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.473s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-23fb3e63-f66e-465c-b2fb-977afd88e9ba tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.915s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:26:03 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a8562537-34e2-45eb-835c-a4dd59e3af7c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b1ffa0dd-1f28-40f1-83e1-4a677302483c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1d2937fc-16d6-4167-9b43-f0f44663deda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f8de1318-fb15-4b5e-9b28-69047b6d48ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a437e642-d3a4-4356-805e-cb68da21167f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4a45616a-3df0-45b0-8271-881c49140a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:26:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.policy [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1471fdc4198b43adbdadb762d584acc6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6ce78721e684c9581fba3a8412b6ac5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.network.neutron [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updating instance_info_cache with network_info: [{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Releasing lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.compute.manager [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:26:04 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Creating image(s)
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "/opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "/opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "/opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.320s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.254s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.174s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk 1073741824" returned: 0 in 0.082s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.342s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:04 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Took 4.18 seconds to deallocate network for instance.
Nov 10 16:26:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-9facfc8b-bcf6-4e40-a943-25ecd558103d req-a2ddb6fb-5056-4284-814d-4e5901b3f874 service nova] [instance: a8562537-34e2-45eb-835c-a4dd59e3af7c] Received event network-vif-deleted-d798edb0-43db-4e57-a080-2ea4db4bd5a3 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.004s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.compute.manager [req-81399dc9-dc8d-4f51-a9c6-eb7eeb55c3a4 req-2d5b0684-94aa-4a46-858c-7da56fa1d4f9 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-unplugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-81399dc9-dc8d-4f51-a9c6-eb7eeb55c3a4 req-2d5b0684-94aa-4a46-858c-7da56fa1d4f9 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-81399dc9-dc8d-4f51-a9c6-eb7eeb55c3a4 req-2d5b0684-94aa-4a46-858c-7da56fa1d4f9 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-81399dc9-dc8d-4f51-a9c6-eb7eeb55c3a4 req-2d5b0684-94aa-4a46-858c-7da56fa1d4f9 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.compute.manager [req-81399dc9-dc8d-4f51-a9c6-eb7eeb55c3a4 req-2d5b0684-94aa-4a46-858c-7da56fa1d4f9 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-unplugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:05 user nova-compute[75102]: WARNING nova.compute.manager [req-81399dc9-dc8d-4f51-a9c6-eb7eeb55c3a4 req-2d5b0684-94aa-4a46-858c-7da56fa1d4f9 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-unplugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.267s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Instance destroyed successfully.
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.objects.instance [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'resources' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646812490',display_name='tempest-TestMinimumBasicScenario-server-646812490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646812490',id=14,image_ref='31966772-0b33-43d9-985a-3cd863a3f140',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjtWoSsTuXJ+NecIc+HuGNvaUIUmHcwzGzDRU9W8SZjunZphg8d3+X9aqSrro8Y8PsmQnAUGCe5x/Av1TLTJIkCTIDnZrG5jKrew8OhuDihgqb6VnALGWyIwxRmqd8oew==',key_name='tempest-TestMinimumBasicScenario-1776384831',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:23:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3975de59dc974b5299a9765364645f24',ramdisk_id='',reservation_id='r-ejr1lcoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31966772-0b33-43d9-985a-3cd863a3f140',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-86254494',owner_user_name='tempest-TestMinimumBasicScenario-86254494-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:26:04Z,user_data=None,user_id='3a487c00935d4baa981cc8a1567af2a8',uuid=b1ffa0dd-1f28-40f1-83e1-4a677302483c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converting VIF {"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_vif [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e6f20ff-75, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=28a52b75-cb44-4128-93e7-73afc2617764) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:05 user nova-compute[75102]: INFO os_vif [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75')
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Cannot resize image /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Ensure instance console log exists: /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHDafhiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:26:05 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9b9630-a9dc-4ecb-a335-b684faab3a9c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:26:05 user nova-compute[75102]: No targets found.
Nov 10 16:26:05 user nova-compute[75102]: iSNS:
Nov 10 16:26:05 user nova-compute[75102]: No targets found.
Nov 10 16:26:05 user nova-compute[75102]: STATIC:
Nov 10 16:26:05 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881
Nov 10 16:26:05 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:26:05 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:26:05 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:26:05 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:26:05 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:26:05 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788
Nov 10 16:26:05 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:26:05 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:26:05 user nova-compute[75102]: FIRMWARE:
Nov 10 16:26:05 user nova-compute[75102]: No targets found.
Nov 10 16:26:05 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:26:05 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:26:05 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9f8561-4c00-4933-bac4-5992ec074839]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b58853e-6375-4934-8f58-0841a42772e2]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:26:05 user nova-compute[75102]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:26:05 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:26:05 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:26:05 user nova-compute[75102]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:26:05 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:26:05 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f745c6200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881'): ({'sde'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Removing single pathed devices sde {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9ad425-4957-4249-82c9-d7e5c5531ff4]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eda11c9-0bde-4ab9-ab48-75dadd97eb2a]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Flushing IO for device /dev/sde {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea24f383-5c85-45a2-9a9f-50bffcd6e009]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[802abcbe-4008-49c0-baa3-bbdaff5412d5]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7be9143-1327-4969-a3ac-64d10a1c75f8]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.687s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:05 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Deleted allocations for instance a8562537-34e2-45eb-835c-a4dd59e3af7c
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6ed277-f831-4b35-bc7b-e1bbec3e67bb]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260]
Nov 10 16:26:05 user nova-compute[75102]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260] successful.
Nov 10 16:26:05 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.network.neutron [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Successfully created port: ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20904394-6930-4219-a07e-08c91e707a9f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] <== disconnect_volume: return (408ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Start _get_guest_xml network_info=[{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=31966772-0b33-43d9-985a-3cd863a3f140,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '31966772-0b33-43d9-985a-3cd863a3f140'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '3f0d113e-8892-4146-873c-f34e8c193ce1', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHDafhiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b1ffa0dd-1f28-40f1-83e1-4a677302483c', 'attached_at': '', 'detached_at': '', 'volume_id': '47a37063-5d3a-443d-a66d-331b3fc1b881', 'serial': '47a37063-5d3a-443d-a66d-331b3fc1b881'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:26:05 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:26:05 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=31966772-0b33-43d9-985a-3cd863a3f140,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.objects.instance [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'vcpu_model' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7c5283b7-e0b8-47a2-8029-3da430b99305 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "a8562537-34e2-45eb-835c-a4dd59e3af7c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.738s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.objects.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Object Instance<b1ffa0dd-1f28-40f1-83e1-4a677302483c> lazy-loaded attributes: resources,vcpu_model {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHDafhiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:26:05 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:26:05 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:26:05 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[794e5b12-bf83-4eed-948d-fa063760fd88]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:26:05 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a1a99c-af35-407e-8278-23d7171ac49d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881] added
Nov 10 16:26:05 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[092d697b-1264-4895-b462-9f4236b92388]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5d4038b-56a5-41ba-97cd-8356b4aae0b5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHDafhiX {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZHDafhiX" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[705bbf6f-dfef-468b-8447-eda3f4467ae0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZHDafhiX'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f77c615-ab88-4ff1-9ad4-8026a0f3d506]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c06c13-81ad-47c8-b80d-3e8bc1dbd10d]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[56aede7e-e4ba-4f57-8e4d-e7c2d275965b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260]
Nov 10 16:26:06 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260] successful.
Nov 10 16:26:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[357d9803-383f-4042-935a-a9a0ba588fbb]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1436125-06fc-4dd6-9aa6-80918376aaa3]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:26:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.323s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cafde2-07a1-4204-91a8-d685ea5fcb6d]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHDafhiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG nova.network.neutron [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Successfully updated port: ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "refresh_cache-4a45616a-3df0-45b0-8271-881c49140a0a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquired lock "refresh_cache-4a45616a-3df0-45b0-8271-881c49140a0a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG nova.network.neutron [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG nova.network.neutron [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:06 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.neutron [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Updating instance_info_cache with network_info: [{"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Releasing lock "refresh_cache-4a45616a-3df0-45b0-8271-881c49140a0a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Instance network_info: |[{"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Start _get_guest_xml network_info=[{"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:26:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:26:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-341555748',display_name='tempest-VolumesAdminNegativeTest-server-341555748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-341555748',id=22,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6ce78721e684c9581fba3a8412b6ac5',ramdisk_id='',reservation_id='r-v89bj9f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1261870727',owner_user_name='tempest-VolumesAdminNegativeTest-1261870727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:26:04Z,user_data=None,user_id='1471fdc4198b43adbdadb762d584acc6',uuid=4a45616a-3df0-45b0-8271-881c49140a0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converting VIF {"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped733bdd-15') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lazy-loading 'pci_devices' on Instance uuid 4a45616a-3df0-45b0-8271-881c49140a0a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:07 user nova-compute[75102]: WARNING nova.compute.manager [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received event network-changed-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Refreshing instance network info cache due to event network-changed-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] Acquiring lock "refresh_cache-4a45616a-3df0-45b0-8271-881c49140a0a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] Acquired lock "refresh_cache-4a45616a-3df0-45b0-8271-881c49140a0a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Refreshing network info cache for port ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:26:07 user nova-compute[75102]:   <uuid>4a45616a-3df0-45b0-8271-881c49140a0a</uuid>
Nov 10 16:26:07 user nova-compute[75102]:   <name>instance-00000016</name>
Nov 10 16:26:07 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:26:07 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:26:07 user nova-compute[75102]:   <metadata>
Nov 10 16:26:07 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:26:07 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:name>tempest-VolumesAdminNegativeTest-server-341555748</nova:name>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:26:07</nova:creationTime>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:26:07 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:26:07 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:owner>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:user uuid="1471fdc4198b43adbdadb762d584acc6">tempest-VolumesAdminNegativeTest-1261870727-project-member</nova:user>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:project uuid="b6ce78721e684c9581fba3a8412b6ac5">tempest-VolumesAdminNegativeTest-1261870727</nova:project>
Nov 10 16:26:07 user nova-compute[75102]:       </nova:owner>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:ports>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:port uuid="ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c">
Nov 10 16:26:07 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 16:26:07 user nova-compute[75102]:         </nova:port>
Nov 10 16:26:07 user nova-compute[75102]:       </nova:ports>
Nov 10 16:26:07 user nova-compute[75102]:     </nova:instance>
Nov 10 16:26:07 user nova-compute[75102]:   </metadata>
Nov 10 16:26:07 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:26:07 user nova-compute[75102]:     <system>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="serial">4a45616a-3df0-45b0-8271-881c49140a0a</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="uuid">4a45616a-3df0-45b0-8271-881c49140a0a</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:26:07 user nova-compute[75102]:     </system>
Nov 10 16:26:07 user nova-compute[75102]:   </sysinfo>
Nov 10 16:26:07 user nova-compute[75102]:   <os>
Nov 10 16:26:07 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:26:07 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:26:07 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:26:07 user nova-compute[75102]:   </os>
Nov 10 16:26:07 user nova-compute[75102]:   <features>
Nov 10 16:26:07 user nova-compute[75102]:     <acpi/>
Nov 10 16:26:07 user nova-compute[75102]:     <apic/>
Nov 10 16:26:07 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:26:07 user nova-compute[75102]:   </features>
Nov 10 16:26:07 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:26:07 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:26:07 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:26:07 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:26:07 user nova-compute[75102]:   </clock>
Nov 10 16:26:07 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:26:07 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:26:07 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:26:07 user nova-compute[75102]:   </cpu>
Nov 10 16:26:07 user nova-compute[75102]:   <devices>
Nov 10 16:26:07 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:26:07 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:26:07 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk"/>
Nov 10 16:26:07 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:26:07 user nova-compute[75102]:     </disk>
Nov 10 16:26:07 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:26:07 user nova-compute[75102]:       <mac address="fa:16:3e:92:00:4a"/>
Nov 10 16:26:07 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:26:07 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:26:07 user nova-compute[75102]:       <target dev="taped733bdd-15"/>
Nov 10 16:26:07 user nova-compute[75102]:     </interface>
Nov 10 16:26:07 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:26:07 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/console.log" append="off"/>
Nov 10 16:26:07 user nova-compute[75102]:     </serial>
Nov 10 16:26:07 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:26:07 user nova-compute[75102]:     <video>
Nov 10 16:26:07 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:26:07 user nova-compute[75102]:     </video>
Nov 10 16:26:07 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:26:07 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:26:07 user nova-compute[75102]:     </rng>
Nov 10 16:26:07 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:26:07 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:26:07 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:26:07 user nova-compute[75102]:     </memballoon>
Nov 10 16:26:07 user nova-compute[75102]:   </devices>
Nov 10 16:26:07 user nova-compute[75102]: </domain>
Nov 10 16:26:07 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-341555748',display_name='tempest-VolumesAdminNegativeTest-server-341555748',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-341555748',id=22,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6ce78721e684c9581fba3a8412b6ac5',ramdisk_id='',reservation_id='r-v89bj9f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1261870727',owner_user_name='tempest-VolumesAdminNegativeTest-1261870727-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:26:04Z,user_data=None,user_id='1471fdc4198b43adbdadb762d584acc6',uuid=4a45616a-3df0-45b0-8271-881c49140a0a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converting VIF {"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped733bdd-15') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG os_vif [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped733bdd-15') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '979534a6-ff8d-5c97-9c0a-cdc7f806390c', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=taped733bdd-15, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=taped733bdd-15, col_values=(('qos', UUID('60811b1d-d007-4e11-b5cd-205b7143ba04')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=taped733bdd-15, col_values=(('external_ids', {'iface-id': 'ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:92:00:4a', 'vm-uuid': '4a45616a-3df0-45b0-8271-881c49140a0a'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:07 user nova-compute[75102]: INFO os_vif [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped733bdd-15')
Nov 10 16:26:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.367s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '26466366634373539', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26466366634373539', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] No VIF found with MAC fa:16:3e:92:00:4a, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646812490',display_name='tempest-TestMinimumBasicScenario-server-646812490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646812490',id=14,image_ref='31966772-0b33-43d9-985a-3cd863a3f140',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjtWoSsTuXJ+NecIc+HuGNvaUIUmHcwzGzDRU9W8SZjunZphg8d3+X9aqSrro8Y8PsmQnAUGCe5x/Av1TLTJIkCTIDnZrG5jKrew8OhuDihgqb6VnALGWyIwxRmqd8oew==',key_name='tempest-TestMinimumBasicScenario-1776384831',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:23:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3975de59dc974b5299a9765364645f24',ramdisk_id='',reservation_id='r-ejr1lcoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31966772-0b33-43d9-985a-3cd863a3f140',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-86254494',owner_user_name='tempest-TestMinimumBasicScenario-86254494-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:26:04Z,user_data=None,user_id='3a487c00935d4baa981cc8a1567af2a8',uuid=b1ffa0dd-1f28-40f1-83e1-4a677302483c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converting VIF {"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'pci_devices' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Object Instance<b1ffa0dd-1f28-40f1-83e1-4a677302483c> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:26:07 user nova-compute[75102]:   <uuid>b1ffa0dd-1f28-40f1-83e1-4a677302483c</uuid>
Nov 10 16:26:07 user nova-compute[75102]:   <name>instance-0000000e</name>
Nov 10 16:26:07 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:26:07 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:26:07 user nova-compute[75102]:   <metadata>
Nov 10 16:26:07 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:26:07 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:name>tempest-TestMinimumBasicScenario-server-646812490</nova:name>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:26:05</nova:creationTime>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:26:07 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:26:07 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:owner>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:user uuid="3a487c00935d4baa981cc8a1567af2a8">tempest-TestMinimumBasicScenario-86254494-project-member</nova:user>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:project uuid="3975de59dc974b5299a9765364645f24">tempest-TestMinimumBasicScenario-86254494</nova:project>
Nov 10 16:26:07 user nova-compute[75102]:       </nova:owner>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:root type="image" uuid="31966772-0b33-43d9-985a-3cd863a3f140"/>
Nov 10 16:26:07 user nova-compute[75102]:       <nova:ports>
Nov 10 16:26:07 user nova-compute[75102]:         <nova:port uuid="2e6f20ff-75fe-49df-944c-ad4040cbdcb6">
Nov 10 16:26:07 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 10 16:26:07 user nova-compute[75102]:         </nova:port>
Nov 10 16:26:07 user nova-compute[75102]:       </nova:ports>
Nov 10 16:26:07 user nova-compute[75102]:     </nova:instance>
Nov 10 16:26:07 user nova-compute[75102]:   </metadata>
Nov 10 16:26:07 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:26:07 user nova-compute[75102]:     <system>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="serial">b1ffa0dd-1f28-40f1-83e1-4a677302483c</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="uuid">b1ffa0dd-1f28-40f1-83e1-4a677302483c</entry>
Nov 10 16:26:07 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:26:07 user nova-compute[75102]:     </system>
Nov 10 16:26:07 user nova-compute[75102]:   </sysinfo>
Nov 10 16:26:07 user nova-compute[75102]:   <os>
Nov 10 16:26:07 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:26:07 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:26:07 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:26:07 user nova-compute[75102]:   </os>
Nov 10 16:26:07 user nova-compute[75102]:   <features>
Nov 10 16:26:07 user nova-compute[75102]:     <acpi/>
Nov 10 16:26:07 user nova-compute[75102]:     <apic/>
Nov 10 16:26:07 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:26:07 user nova-compute[75102]:   </features>
Nov 10 16:26:07 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:26:07 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:26:07 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:26:07 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:26:07 user nova-compute[75102]:   </clock>
Nov 10 16:26:07 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:26:07 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:26:07 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:26:07 user nova-compute[75102]:   </cpu>
Nov 10 16:26:07 user nova-compute[75102]:   <devices>
Nov 10 16:26:07 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:26:07 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:26:07 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk"/>
Nov 10 16:26:07 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:26:07 user nova-compute[75102]:     </disk>
Nov 10 16:26:07 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:26:07 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:26:07 user nova-compute[75102]:       <source dev="/dev/sdd"/>
Nov 10 16:26:07 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:26:07 user nova-compute[75102]:       <serial>47a37063-5d3a-443d-a66d-331b3fc1b881</serial>
Nov 10 16:26:07 user nova-compute[75102]:     </disk>
Nov 10 16:26:07 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:26:07 user nova-compute[75102]:       <mac address="fa:16:3e:d3:d8:7a"/>
Nov 10 16:26:07 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:26:07 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:26:07 user nova-compute[75102]:       <target dev="tap2e6f20ff-75"/>
Nov 10 16:26:07 user nova-compute[75102]:     </interface>
Nov 10 16:26:07 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:26:07 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/console.log" append="off"/>
Nov 10 16:26:07 user nova-compute[75102]:     </serial>
Nov 10 16:26:07 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:26:07 user nova-compute[75102]:     <video>
Nov 10 16:26:07 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:26:07 user nova-compute[75102]:     </video>
Nov 10 16:26:07 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:26:07 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:26:07 user nova-compute[75102]:     </rng>
Nov 10 16:26:07 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:26:07 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:26:07 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:26:07 user nova-compute[75102]:     </memballoon>
Nov 10 16:26:07 user nova-compute[75102]:   </devices>
Nov 10 16:26:07 user nova-compute[75102]: </domain>
Nov 10 16:26:07 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Updated VIF entry in instance network info cache for port ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Updating instance_info_cache with network_info: [{"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-87b46062-c121-4aa1-9d0b-eeefd6032a0d req-4f2d774b-7ae7-4a52-9c9e-4a02c56830e8 service nova] Releasing lock "refresh_cache-4a45616a-3df0-45b0-8271-881c49140a0a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'trusted_certs' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Object Instance<b1ffa0dd-1f28-40f1-83e1-4a677302483c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9 --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:26:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Cannot resize image /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG nova.objects.instance [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'migration_context' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG nova.objects.base [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Object Instance<b1ffa0dd-1f28-40f1-83e1-4a677302483c> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646812490',display_name='tempest-TestMinimumBasicScenario-server-646812490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646812490',id=14,image_ref='31966772-0b33-43d9-985a-3cd863a3f140',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjtWoSsTuXJ+NecIc+HuGNvaUIUmHcwzGzDRU9W8SZjunZphg8d3+X9aqSrro8Y8PsmQnAUGCe5x/Av1TLTJIkCTIDnZrG5jKrew8OhuDihgqb6VnALGWyIwxRmqd8oew==',key_name='tempest-TestMinimumBasicScenario-1776384831',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:23:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3975de59dc974b5299a9765364645f24',ramdisk_id='',reservation_id='r-ejr1lcoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31966772-0b33-43d9-985a-3cd863a3f140',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-86254494',owner_user_name='tempest-TestMinimumBasicScenario-86254494-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:26:04Z,user_data=None,user_id='3a487c00935d4baa981cc8a1567af2a8',uuid=b1ffa0dd-1f28-40f1-83e1-4a677302483c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converting VIF {"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG os_vif [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c945dd7a-ba7e-5d9a-b5ff-ba2d9915ea82', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e6f20ff-75, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e6f20ff-75, col_values=(('qos', UUID('8e7eac42-96bb-44ac-a46d-d847624a0a79')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e6f20ff-75, col_values=(('external_ids', {'iface-id': '2e6f20ff-75fe-49df-944c-ad4040cbdcb6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d3:d8:7a', 'vm-uuid': 'b1ffa0dd-1f28-40f1-83e1-4a677302483c'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:08 user nova-compute[75102]: INFO os_vif [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75')
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-2f1688b3-e87d-4486-9a1d-af14beb9be27 req-51b43d09-713a-4b55-936d-2a98600e13f7 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received event network-vif-plugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2f1688b3-e87d-4486-9a1d-af14beb9be27 req-51b43d09-713a-4b55-936d-2a98600e13f7 service nova] Acquiring lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2f1688b3-e87d-4486-9a1d-af14beb9be27 req-51b43d09-713a-4b55-936d-2a98600e13f7 service nova] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2f1688b3-e87d-4486-9a1d-af14beb9be27 req-51b43d09-713a-4b55-936d-2a98600e13f7 service nova] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-2f1688b3-e87d-4486-9a1d-af14beb9be27 req-51b43d09-713a-4b55-936d-2a98600e13f7 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] No waiting events found dispatching network-vif-plugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:09 user nova-compute[75102]: WARNING nova.compute.manager [req-2f1688b3-e87d-4486-9a1d-af14beb9be27 req-51b43d09-713a-4b55-936d-2a98600e13f7 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received unexpected event network-vif-plugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c for instance with vm_state building and task_state spawning.
Nov 10 16:26:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-88c84fff-aa82-48d8-a04e-c32be551ad1d req-ce65c0fd-fd54-4724-b74e-19361572c276 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-changed-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-88c84fff-aa82-48d8-a04e-c32be551ad1d req-ce65c0fd-fd54-4724-b74e-19361572c276 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Refreshing instance network info cache due to event network-changed-717a43fb-d615-4290-806b-cfaa817bee6f. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:26:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88c84fff-aa82-48d8-a04e-c32be551ad1d req-ce65c0fd-fd54-4724-b74e-19361572c276 service nova] Acquiring lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:26:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88c84fff-aa82-48d8-a04e-c32be551ad1d req-ce65c0fd-fd54-4724-b74e-19361572c276 service nova] Acquired lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:26:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-88c84fff-aa82-48d8-a04e-c32be551ad1d req-ce65c0fd-fd54-4724-b74e-19361572c276 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Refreshing network info cache for port 717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:26:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-88c84fff-aa82-48d8-a04e-c32be551ad1d req-ce65c0fd-fd54-4724-b74e-19361572c276 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updated VIF entry in instance network info cache for port 717a43fb-d615-4290-806b-cfaa817bee6f. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-88c84fff-aa82-48d8-a04e-c32be551ad1d req-ce65c0fd-fd54-4724-b74e-19361572c276 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating instance_info_cache with network_info: [{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88c84fff-aa82-48d8-a04e-c32be551ad1d req-ce65c0fd-fd54-4724-b74e-19361572c276 service nova] Releasing lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received event network-vif-plugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] Acquiring lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] No waiting events found dispatching network-vif-plugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:11 user nova-compute[75102]: WARNING nova.compute.manager [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received unexpected event network-vif-plugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c for instance with vm_state building and task_state spawning.
Nov 10 16:26:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:11 user nova-compute[75102]: WARNING nova.compute.manager [req-90c148cf-78d7-4d68-ae0d-4004c1962117 req-10493be4-b920-4f89-8900-aad64d6384d7 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state active and task_state reboot_started_hard.
Nov 10 16:26:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:26:11 user nova-compute[75102]: INFO nova.compute.manager [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] instance snapshotting
Nov 10 16:26:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Beginning live snapshot process
Nov 10 16:26:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json -f qcow2 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json -f qcow2" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json -f qcow2 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json -f qcow2" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnjc5ean_/ab76ea2bceb8470d823b3197d0c7a1d9.delta 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpnjc5ean_/ab76ea2bceb8470d823b3197d0c7a1d9.delta 1073741824" returned: 0 in 0.049s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:26:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Instance rebooted successfully.
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-04e433ec-797d-4b97-9853-fe2c2f3a0901 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.602s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:26:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Instance spawned successfully.
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:12 user nova-compute[75102]: INFO nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Took 8.80 seconds to spawn the instance on the hypervisor.
Nov 10 16:26:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:26:13 user nova-compute[75102]: INFO nova.compute.manager [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Took 12.53 seconds to build instance.
Nov 10 16:26:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cefc714f-16bf-4c58-9a8a-b59f491e0b32 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "4a45616a-3df0-45b0-8271-881c49140a0a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.668s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:26:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-5ed23d4f-b1bb-4833-90fc-027740ff6fa9 req-38ce75b7-bf77-43ef-8e55-8119173a3768 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5ed23d4f-b1bb-4833-90fc-027740ff6fa9 req-38ce75b7-bf77-43ef-8e55-8119173a3768 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5ed23d4f-b1bb-4833-90fc-027740ff6fa9 req-38ce75b7-bf77-43ef-8e55-8119173a3768 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5ed23d4f-b1bb-4833-90fc-027740ff6fa9 req-38ce75b7-bf77-43ef-8e55-8119173a3768 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-5ed23d4f-b1bb-4833-90fc-027740ff6fa9 req-38ce75b7-bf77-43ef-8e55-8119173a3768 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:13 user nova-compute[75102]: WARNING nova.compute.manager [req-5ed23d4f-b1bb-4833-90fc-027740ff6fa9 req-38ce75b7-bf77-43ef-8e55-8119173a3768 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state active and task_state None.
Nov 10 16:26:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:26:13 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 16:26:14 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:26:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnjc5ean_/ab76ea2bceb8470d823b3197d0c7a1d9.delta /opt/stack/data/nova/instances/snapshots/tmpnjc5ean_/ab76ea2bceb8470d823b3197d0c7a1d9 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpnjc5ean_/ab76ea2bceb8470d823b3197d0c7a1d9.delta /opt/stack/data/nova/instances/snapshots/tmpnjc5ean_/ab76ea2bceb8470d823b3197d0c7a1d9" returned: 0 in 0.598s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Snapshot extracted, beginning image upload
Nov 10 16:26:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Snapshot image upload complete
Nov 10 16:26:18 user nova-compute[75102]: INFO nova.compute.manager [None req-84bb4b8c-855f-4638-b317-c1c98bc5f90e tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Took 6.40 seconds to snapshot the instance on the hypervisor.
Nov 10 16:26:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:43 user nova-compute[75102]: INFO nova.compute.manager [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Terminating instance
Nov 10 16:26:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-452f5d4b-e539-4785-8345-562dbe4b3193 req-6ac47ff5-1a4f-4f2f-a2f4-35672e46ae0b service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received event network-vif-unplugged-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-452f5d4b-e539-4785-8345-562dbe4b3193 req-6ac47ff5-1a4f-4f2f-a2f4-35672e46ae0b service nova] Acquiring lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-452f5d4b-e539-4785-8345-562dbe4b3193 req-6ac47ff5-1a4f-4f2f-a2f4-35672e46ae0b service nova] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-452f5d4b-e539-4785-8345-562dbe4b3193 req-6ac47ff5-1a4f-4f2f-a2f4-35672e46ae0b service nova] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-452f5d4b-e539-4785-8345-562dbe4b3193 req-6ac47ff5-1a4f-4f2f-a2f4-35672e46ae0b service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] No waiting events found dispatching network-vif-unplugged-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-452f5d4b-e539-4785-8345-562dbe4b3193 req-6ac47ff5-1a4f-4f2f-a2f4-35672e46ae0b service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received event network-vif-unplugged-11ba77e8-7336-4d39-8527-742d639d4f5a for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:26:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Instance destroyed successfully.
Nov 10 16:26:44 user nova-compute[75102]: DEBUG nova.objects.instance [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lazy-loading 'resources' on Instance uuid f8de1318-fb15-4b5e-9b28-69047b6d48ac {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:24:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-156871188',display_name='tempest-VolumesActionsTest-instance-156871188',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-156871188',id=18,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bfa048a64b74cef84d4645eb627c0eb',ramdisk_id='',reservation_id='r-oxriofft',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-880387838',owner_user_name='tempest-VolumesActionsTest-880387838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:25:03Z,user_data=None,user_id='1c97d44d1a1a4d3ba6f7e4f7f57dcbee',uuid=f8de1318-fb15-4b5e-9b28-69047b6d48ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "11ba77e8-7336-4d39-8527-742d639d4f5a", "address": "fa:16:3e:53:82:95", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba77e8-73", "ovs_interfaceid": "11ba77e8-7336-4d39-8527-742d639d4f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converting VIF {"id": "11ba77e8-7336-4d39-8527-742d639d4f5a", "address": "fa:16:3e:53:82:95", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap11ba77e8-73", "ovs_interfaceid": "11ba77e8-7336-4d39-8527-742d639d4f5a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:53:82:95,bridge_name='br-int',has_traffic_filtering=True,id=11ba77e8-7336-4d39-8527-742d639d4f5a,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba77e8-73') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG os_vif [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:82:95,bridge_name='br-int',has_traffic_filtering=True,id=11ba77e8-7336-4d39-8527-742d639d4f5a,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba77e8-73') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap11ba77e8-73, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bb3661ee-a598-4590-9423-43ece2367af4) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:44 user nova-compute[75102]: INFO os_vif [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:53:82:95,bridge_name='br-int',has_traffic_filtering=True,id=11ba77e8-7336-4d39-8527-742d639d4f5a,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap11ba77e8-73')
Nov 10 16:26:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Deleting instance files /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac_del
Nov 10 16:26:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Deletion of /opt/stack/data/nova/instances/f8de1318-fb15-4b5e-9b28-69047b6d48ac_del complete
Nov 10 16:26:44 user nova-compute[75102]: INFO nova.compute.manager [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 10 16:26:44 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:44 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Took 0.53 seconds to deallocate network for instance.
Nov 10 16:26:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-c7c2479b-2593-4faa-b850-f439f9812c86 req-7086be78-98cc-44f8-8461-76be3f42d36a service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received event network-vif-deleted-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:45 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:26:45 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:26:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.440s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:45 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Deleted allocations for instance f8de1318-fb15-4b5e-9b28-69047b6d48ac
Nov 10 16:26:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1d35f3a8-bc1e-4c89-8e3e-3324dd198868 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.228s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-6e49eeee-2868-4b96-bb4d-6ccda606c5b0 req-cb8632d5-25e3-459c-adca-c14dd5549fc6 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received event network-vif-plugged-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6e49eeee-2868-4b96-bb4d-6ccda606c5b0 req-cb8632d5-25e3-459c-adca-c14dd5549fc6 service nova] Acquiring lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6e49eeee-2868-4b96-bb4d-6ccda606c5b0 req-cb8632d5-25e3-459c-adca-c14dd5549fc6 service nova] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6e49eeee-2868-4b96-bb4d-6ccda606c5b0 req-cb8632d5-25e3-459c-adca-c14dd5549fc6 service nova] Lock "f8de1318-fb15-4b5e-9b28-69047b6d48ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-6e49eeee-2868-4b96-bb4d-6ccda606c5b0 req-cb8632d5-25e3-459c-adca-c14dd5549fc6 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] No waiting events found dispatching network-vif-plugged-11ba77e8-7336-4d39-8527-742d639d4f5a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:45 user nova-compute[75102]: WARNING nova.compute.manager [req-6e49eeee-2868-4b96-bb4d-6ccda606c5b0 req-cb8632d5-25e3-459c-adca-c14dd5549fc6 service nova] [instance: f8de1318-fb15-4b5e-9b28-69047b6d48ac] Received unexpected event network-vif-plugged-11ba77e8-7336-4d39-8527-742d639d4f5a for instance with vm_state deleted and task_state None.
Nov 10 16:26:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 16:26:51 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:26:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:52 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:26:52 user nova-compute[75102]: INFO nova.compute.claims [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Claim successful on node user
Nov 10 16:26:53 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG nova.network.neutron [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:26:53 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:26:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG nova.policy [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '95ef5e9028c34d61b880bff813a53216', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6d408293bc34453b58b852baca77d35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:26:53 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Creating image(s)
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "/opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "/opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "/opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.197s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.194s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk 1073741824" returned: 0 in 0.058s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.260s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Successfully created port: 68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Cannot resize image /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Ensure instance console log exists: /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Successfully updated port: 68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "refresh_cache-8475b9aa-13f8-4cf4-9636-743bee133121" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquired lock "refresh_cache-8475b9aa-13f8-4cf4-9636-743bee133121" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-6740bd62-b2fd-4a83-bafa-5c6e3b469b78 req-9ff97b3b-6e6a-44ea-acd5-c81ba1c8878c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received event network-changed-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-6740bd62-b2fd-4a83-bafa-5c6e3b469b78 req-9ff97b3b-6e6a-44ea-acd5-c81ba1c8878c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Refreshing instance network info cache due to event network-changed-68b9de94-fc76-474f-9d06-cd6552434dec. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6740bd62-b2fd-4a83-bafa-5c6e3b469b78 req-9ff97b3b-6e6a-44ea-acd5-c81ba1c8878c service nova] Acquiring lock "refresh_cache-8475b9aa-13f8-4cf4-9636-743bee133121" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:26:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.neutron [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Updating instance_info_cache with network_info: [{"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Releasing lock "refresh_cache-8475b9aa-13f8-4cf4-9636-743bee133121" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Instance network_info: |[{"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6740bd62-b2fd-4a83-bafa-5c6e3b469b78 req-9ff97b3b-6e6a-44ea-acd5-c81ba1c8878c service nova] Acquired lock "refresh_cache-8475b9aa-13f8-4cf4-9636-743bee133121" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-6740bd62-b2fd-4a83-bafa-5c6e3b469b78 req-9ff97b3b-6e6a-44ea-acd5-c81ba1c8878c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Refreshing network info cache for port 68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Start _get_guest_xml network_info=[{"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:26:55 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:26:55 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261702710',display_name='tempest-AttachVolumeTestJSON-server-1261702710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261702710',id=23,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZJ1wBHsihPr/s+rlNAv+zFEgK766MQ+rn3qAd7rK50j2eVhQjzn/GyKRo3rAHUUIwXLktEKEpq1iLnuE94h45Cl31fdZrZ/zqVri/zL3HXHlX3LSl3EmPCkbDHTspg1w==',key_name='tempest-keypair-1119004403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d408293bc34453b58b852baca77d35',ramdisk_id='',reservation_id='r-nh9h8vkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1946940767',owner_user_name='tempest-AttachVolumeTestJSON-1946940767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95ef5e9028c34d61b880bff813a53216',uuid=8475b9aa-13f8-4cf4-9636-743bee133121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converting VIF {"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=68b9de94-fc76-474f-9d06-cd6552434dec,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b9de94-fc') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.objects.instance [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'pci_devices' on Instance uuid 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:26:55 user nova-compute[75102]:   <uuid>8475b9aa-13f8-4cf4-9636-743bee133121</uuid>
Nov 10 16:26:55 user nova-compute[75102]:   <name>instance-00000017</name>
Nov 10 16:26:55 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:26:55 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:26:55 user nova-compute[75102]:   <metadata>
Nov 10 16:26:55 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:26:55 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:26:55 user nova-compute[75102]:       <nova:name>tempest-AttachVolumeTestJSON-server-1261702710</nova:name>
Nov 10 16:26:55 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:26:55</nova:creationTime>
Nov 10 16:26:55 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:26:55 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:26:55 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:26:55 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:26:55 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:26:55 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:26:55 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:26:55 user nova-compute[75102]:       <nova:owner>
Nov 10 16:26:55 user nova-compute[75102]:         <nova:user uuid="95ef5e9028c34d61b880bff813a53216">tempest-AttachVolumeTestJSON-1946940767-project-member</nova:user>
Nov 10 16:26:55 user nova-compute[75102]:         <nova:project uuid="d6d408293bc34453b58b852baca77d35">tempest-AttachVolumeTestJSON-1946940767</nova:project>
Nov 10 16:26:55 user nova-compute[75102]:       </nova:owner>
Nov 10 16:26:55 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:26:55 user nova-compute[75102]:       <nova:ports>
Nov 10 16:26:55 user nova-compute[75102]:         <nova:port uuid="68b9de94-fc76-474f-9d06-cd6552434dec">
Nov 10 16:26:55 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 16:26:55 user nova-compute[75102]:         </nova:port>
Nov 10 16:26:55 user nova-compute[75102]:       </nova:ports>
Nov 10 16:26:55 user nova-compute[75102]:     </nova:instance>
Nov 10 16:26:55 user nova-compute[75102]:   </metadata>
Nov 10 16:26:55 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:26:55 user nova-compute[75102]:     <system>
Nov 10 16:26:55 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:26:55 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:26:55 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:26:55 user nova-compute[75102]:       <entry name="serial">8475b9aa-13f8-4cf4-9636-743bee133121</entry>
Nov 10 16:26:55 user nova-compute[75102]:       <entry name="uuid">8475b9aa-13f8-4cf4-9636-743bee133121</entry>
Nov 10 16:26:55 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:26:55 user nova-compute[75102]:     </system>
Nov 10 16:26:55 user nova-compute[75102]:   </sysinfo>
Nov 10 16:26:55 user nova-compute[75102]:   <os>
Nov 10 16:26:55 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:26:55 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:26:55 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:26:55 user nova-compute[75102]:   </os>
Nov 10 16:26:55 user nova-compute[75102]:   <features>
Nov 10 16:26:55 user nova-compute[75102]:     <acpi/>
Nov 10 16:26:55 user nova-compute[75102]:     <apic/>
Nov 10 16:26:55 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:26:55 user nova-compute[75102]:   </features>
Nov 10 16:26:55 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:26:55 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:26:55 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:26:55 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:26:55 user nova-compute[75102]:   </clock>
Nov 10 16:26:55 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:26:55 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:26:55 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:26:55 user nova-compute[75102]:   </cpu>
Nov 10 16:26:55 user nova-compute[75102]:   <devices>
Nov 10 16:26:55 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:26:55 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:26:55 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk"/>
Nov 10 16:26:55 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:26:55 user nova-compute[75102]:     </disk>
Nov 10 16:26:55 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:26:55 user nova-compute[75102]:       <mac address="fa:16:3e:d4:75:b3"/>
Nov 10 16:26:55 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:26:55 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:26:55 user nova-compute[75102]:       <target dev="tap68b9de94-fc"/>
Nov 10 16:26:55 user nova-compute[75102]:     </interface>
Nov 10 16:26:55 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:26:55 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/console.log" append="off"/>
Nov 10 16:26:55 user nova-compute[75102]:     </serial>
Nov 10 16:26:55 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:26:55 user nova-compute[75102]:     <video>
Nov 10 16:26:55 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:26:55 user nova-compute[75102]:     </video>
Nov 10 16:26:55 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:26:55 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:26:55 user nova-compute[75102]:     </rng>
Nov 10 16:26:55 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:26:55 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:26:55 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:26:55 user nova-compute[75102]:     </memballoon>
Nov 10 16:26:55 user nova-compute[75102]:   </devices>
Nov 10 16:26:55 user nova-compute[75102]: </domain>
Nov 10 16:26:55 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261702710',display_name='tempest-AttachVolumeTestJSON-server-1261702710',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261702710',id=23,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZJ1wBHsihPr/s+rlNAv+zFEgK766MQ+rn3qAd7rK50j2eVhQjzn/GyKRo3rAHUUIwXLktEKEpq1iLnuE94h45Cl31fdZrZ/zqVri/zL3HXHlX3LSl3EmPCkbDHTspg1w==',key_name='tempest-keypair-1119004403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d6d408293bc34453b58b852baca77d35',ramdisk_id='',reservation_id='r-nh9h8vkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-1946940767',owner_user_name='tempest-AttachVolumeTestJSON-1946940767-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:26:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95ef5e9028c34d61b880bff813a53216',uuid=8475b9aa-13f8-4cf4-9636-743bee133121,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converting VIF {"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=68b9de94-fc76-474f-9d06-cd6552434dec,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b9de94-fc') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG os_vif [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=68b9de94-fc76-474f-9d06-cd6552434dec,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b9de94-fc') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd4b9855a-6317-5350-9be3-b8add3122f81', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap68b9de94-fc, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap68b9de94-fc, col_values=(('qos', UUID('9f6d85b1-bc48-4b53-8996-6e10b0098cc3')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap68b9de94-fc, col_values=(('external_ids', {'iface-id': '68b9de94-fc76-474f-9d06-cd6552434dec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:75:b3', 'vm-uuid': '8475b9aa-13f8-4cf4-9636-743bee133121'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:55 user nova-compute[75102]: INFO os_vif [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=68b9de94-fc76-474f-9d06-cd6552434dec,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b9de94-fc')
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No VIF found with MAC fa:16:3e:d4:75:b3, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-6740bd62-b2fd-4a83-bafa-5c6e3b469b78 req-9ff97b3b-6e6a-44ea-acd5-c81ba1c8878c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Updated VIF entry in instance network info cache for port 68b9de94-fc76-474f-9d06-cd6552434dec. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-6740bd62-b2fd-4a83-bafa-5c6e3b469b78 req-9ff97b3b-6e6a-44ea-acd5-c81ba1c8878c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Updating instance_info_cache with network_info: [{"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6740bd62-b2fd-4a83-bafa-5c6e3b469b78 req-9ff97b3b-6e6a-44ea-acd5-c81ba1c8878c service nova] Releasing lock "refresh_cache-8475b9aa-13f8-4cf4-9636-743bee133121" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Updating instance_info_cache with network_info: [{"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-e4c81c8e-88f5-4789-8f0a-034965ec6f5e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:26:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:26:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-da934de7-84af-44aa-a421-6ffb43ee0165 req-d95ce512-ce7f-4b41-bb3e-714dbc029d0f service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received event network-vif-plugged-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-da934de7-84af-44aa-a421-6ffb43ee0165 req-d95ce512-ce7f-4b41-bb3e-714dbc029d0f service nova] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-da934de7-84af-44aa-a421-6ffb43ee0165 req-d95ce512-ce7f-4b41-bb3e-714dbc029d0f service nova] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-da934de7-84af-44aa-a421-6ffb43ee0165 req-d95ce512-ce7f-4b41-bb3e-714dbc029d0f service nova] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-da934de7-84af-44aa-a421-6ffb43ee0165 req-d95ce512-ce7f-4b41-bb3e-714dbc029d0f service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] No waiting events found dispatching network-vif-plugged-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:56 user nova-compute[75102]: WARNING nova.compute.manager [req-da934de7-84af-44aa-a421-6ffb43ee0165 req-d95ce512-ce7f-4b41-bb3e-714dbc029d0f service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received unexpected event network-vif-plugged-68b9de94-fc76-474f-9d06-cd6552434dec for instance with vm_state building and task_state spawning.
Nov 10 16:26:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:26:58 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Instance spawned successfully.
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received event network-vif-plugged-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] No waiting events found dispatching network-vif-plugged-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:26:58 user nova-compute[75102]: WARNING nova.compute.manager [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received unexpected event network-vif-plugged-68b9de94-fc76-474f-9d06-cd6552434dec for instance with vm_state building and task_state spawning.
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received event network-changed-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Refreshing instance network info cache due to event network-changed-64f6cf0e-865d-401e-b269-2df0b13d43c2. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] Acquiring lock "refresh_cache-a437e642-d3a4-4356-805e-cb68da21167f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] Acquired lock "refresh_cache-a437e642-d3a4-4356-805e-cb68da21167f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.network.neutron [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Refreshing network info cache for port 64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:58 user nova-compute[75102]: INFO nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 10 16:26:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:26:59 user nova-compute[75102]: INFO nova.compute.manager [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Took 6.19 seconds to build instance.
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63ef23b8-7403-4fce-9db5-0abb916e767b tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.298s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "3f35d18d-c23d-4628-80e7-52e0288fc39e" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:26:59 user nova-compute[75102]: INFO nova.compute.manager [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Unshelving
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:26:59 user nova-compute[75102]: INFO nova.virt.block_device [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Booting with volume 03285289-a19c-4a6f-bb20-c2596fc118f4 at /dev/vdc
Nov 10 16:26:59 user nova-compute[75102]: DEBUG os_brick.utils [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[35ddee5c-71c3-474b-942c-a174d9e16735]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed697e9-5972-4743-9f77-ccd5b4f71129]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c79419-ae96-4c97-9030-2a42b0a856c6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bb651f6-5029-43ff-aa9b-2a14e47b11c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:26:59 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ee0cce-579e-4a4a-b7bc-72ff809855e2]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG os_brick.utils [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Updating existing volume attachment record: a3323518-8ba7-43bf-801e-971a57efaea3 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG nova.network.neutron [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Updated VIF entry in instance network info cache for port 64f6cf0e-865d-401e-b269-2df0b13d43c2. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG nova.network.neutron [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Updating instance_info_cache with network_info: [{"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:26:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e1e20ed6-6dab-4f73-8d7b-378adc2023b5 req-d38b311f-f815-4470-be73-4e30e45495bd service nova] Releasing lock "refresh_cache-a437e642-d3a4-4356-805e-cb68da21167f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquiring lock "3f64688a-b3db-4879-81f9-0a35923aae42" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "3f64688a-b3db-4879-81f9-0a35923aae42" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:00 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:27:00 user nova-compute[75102]: INFO nova.compute.claims [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Claim successful on node user
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.920s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:27:01 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:27:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG nova.policy [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ca09662ed2434005b610a4b2366c3a96', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '584ee1f0e06a4b0e99a0dba965541b18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:27:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Creating image(s)
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "/opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "/opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.227s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.200s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk 1073741824" returned: 0 in 0.055s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.264s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Successfully created port: 75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.201s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Cannot resize image /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Ensure instance console log exists: /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:27:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.235s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Successfully updated port: 75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-0e1aa673-b778-4ecd-ba33-b51bf030938e req-0f237441-7a08-456f-bd45-8bb365dff70a service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received event network-changed-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-0e1aa673-b778-4ecd-ba33-b51bf030938e req-0f237441-7a08-456f-bd45-8bb365dff70a service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Refreshing instance network info cache due to event network-changed-75115f2e-2399-4cc5-8a58-84ea4e3501e1. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0e1aa673-b778-4ecd-ba33-b51bf030938e req-0f237441-7a08-456f-bd45-8bb365dff70a service nova] Acquiring lock "refresh_cache-3f64688a-b3db-4879-81f9-0a35923aae42" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0e1aa673-b778-4ecd-ba33-b51bf030938e req-0f237441-7a08-456f-bd45-8bb365dff70a service nova] Acquired lock "refresh_cache-3f64688a-b3db-4879-81f9-0a35923aae42" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG nova.network.neutron [req-0e1aa673-b778-4ecd-ba33-b51bf030938e req-0f237441-7a08-456f-bd45-8bb365dff70a service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Refreshing network info cache for port 75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquiring lock "refresh_cache-3f64688a-b3db-4879-81f9-0a35923aae42" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:27:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:27:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:27:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7315MB free_disk=25.134021759033203GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:03 user nova-compute[75102]: DEBUG nova.network.neutron [req-0e1aa673-b778-4ecd-ba33-b51bf030938e req-0f237441-7a08-456f-bd45-8bb365dff70a service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 731624eb-b0c0-42c1-80cf-2dd76932e92a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b1ffa0dd-1f28-40f1-83e1-4a677302483c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1d2937fc-16d6-4167-9b43-f0f44663deda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a437e642-d3a4-4356-805e-cb68da21167f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4a45616a-3df0-45b0-8271-881c49140a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8475b9aa-13f8-4cf4-9636-743bee133121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f64688a-b3db-4879-81f9-0a35923aae42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=11GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-0e1aa673-b778-4ecd-ba33-b51bf030938e req-0f237441-7a08-456f-bd45-8bb365dff70a service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0e1aa673-b778-4ecd-ba33-b51bf030938e req-0f237441-7a08-456f-bd45-8bb365dff70a service nova] Releasing lock "refresh_cache-3f64688a-b3db-4879-81f9-0a35923aae42" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquired lock "refresh_cache-3f64688a-b3db-4879-81f9-0a35923aae42" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Updating instance_info_cache with network_info: [{"id": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "address": "fa:16:3e:f5:5c:67", "network": {"id": "06ba9c71-267c-4c62-9154-c6835b7b274a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "27ab322133744b01aba75af5d356371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75115f2e-23", "ovs_interfaceid": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Releasing lock "refresh_cache-3f64688a-b3db-4879-81f9-0a35923aae42" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Instance network_info: |[{"id": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "address": "fa:16:3e:f5:5c:67", "network": {"id": "06ba9c71-267c-4c62-9154-c6835b7b274a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "27ab322133744b01aba75af5d356371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75115f2e-23", "ovs_interfaceid": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Start _get_guest_xml network_info=[{"id": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "address": "fa:16:3e:f5:5c:67", "network": {"id": "06ba9c71-267c-4c62-9154-c6835b7b274a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "27ab322133744b01aba75af5d356371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75115f2e-23", "ovs_interfaceid": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:27:04 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:27:04 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-329465846',display_name='tempest-VolumesNegativeTest-instance-329465846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-329465846',id=24,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584ee1f0e06a4b0e99a0dba965541b18',ramdisk_id='',reservation_id='r-tagvtw6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-777079920',owner_user_name='tempest-VolumesNegativeTest-777079920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:27:02Z,user_data=None,user_id='ca09662ed2434005b610a4b2366c3a96',uuid=3f64688a-b3db-4879-81f9-0a35923aae42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "address": "fa:16:3e:f5:5c:67", "network": {"id": "06ba9c71-267c-4c62-9154-c6835b7b274a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "27ab322133744b01aba75af5d356371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75115f2e-23", "ovs_interfaceid": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Converting VIF {"id": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "address": "fa:16:3e:f5:5c:67", "network": {"id": "06ba9c71-267c-4c62-9154-c6835b7b274a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "27ab322133744b01aba75af5d356371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75115f2e-23", "ovs_interfaceid": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:67,bridge_name='br-int',has_traffic_filtering=True,id=75115f2e-2399-4cc5-8a58-84ea4e3501e1,network=Network(06ba9c71-267c-4c62-9154-c6835b7b274a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75115f2e-23') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.objects.instance [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f64688a-b3db-4879-81f9-0a35923aae42 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:27:04 user nova-compute[75102]:   <uuid>3f64688a-b3db-4879-81f9-0a35923aae42</uuid>
Nov 10 16:27:04 user nova-compute[75102]:   <name>instance-00000018</name>
Nov 10 16:27:04 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:27:04 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:27:04 user nova-compute[75102]:   <metadata>
Nov 10 16:27:04 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:27:04 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:27:04 user nova-compute[75102]:       <nova:name>tempest-VolumesNegativeTest-instance-329465846</nova:name>
Nov 10 16:27:04 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:27:04</nova:creationTime>
Nov 10 16:27:04 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:27:04 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:27:04 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:27:04 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:27:04 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:27:04 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:27:04 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:27:04 user nova-compute[75102]:       <nova:owner>
Nov 10 16:27:04 user nova-compute[75102]:         <nova:user uuid="ca09662ed2434005b610a4b2366c3a96">tempest-VolumesNegativeTest-777079920-project-member</nova:user>
Nov 10 16:27:04 user nova-compute[75102]:         <nova:project uuid="584ee1f0e06a4b0e99a0dba965541b18">tempest-VolumesNegativeTest-777079920</nova:project>
Nov 10 16:27:04 user nova-compute[75102]:       </nova:owner>
Nov 10 16:27:04 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:27:04 user nova-compute[75102]:       <nova:ports>
Nov 10 16:27:04 user nova-compute[75102]:         <nova:port uuid="75115f2e-2399-4cc5-8a58-84ea4e3501e1">
Nov 10 16:27:04 user nova-compute[75102]:           <nova:ip type="fixed" address="192.168.233.144" ipVersion="4"/>
Nov 10 16:27:04 user nova-compute[75102]:         </nova:port>
Nov 10 16:27:04 user nova-compute[75102]:       </nova:ports>
Nov 10 16:27:04 user nova-compute[75102]:     </nova:instance>
Nov 10 16:27:04 user nova-compute[75102]:   </metadata>
Nov 10 16:27:04 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:27:04 user nova-compute[75102]:     <system>
Nov 10 16:27:04 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:27:04 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:27:04 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:27:04 user nova-compute[75102]:       <entry name="serial">3f64688a-b3db-4879-81f9-0a35923aae42</entry>
Nov 10 16:27:04 user nova-compute[75102]:       <entry name="uuid">3f64688a-b3db-4879-81f9-0a35923aae42</entry>
Nov 10 16:27:04 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:27:04 user nova-compute[75102]:     </system>
Nov 10 16:27:04 user nova-compute[75102]:   </sysinfo>
Nov 10 16:27:04 user nova-compute[75102]:   <os>
Nov 10 16:27:04 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:27:04 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:27:04 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:27:04 user nova-compute[75102]:   </os>
Nov 10 16:27:04 user nova-compute[75102]:   <features>
Nov 10 16:27:04 user nova-compute[75102]:     <acpi/>
Nov 10 16:27:04 user nova-compute[75102]:     <apic/>
Nov 10 16:27:04 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:27:04 user nova-compute[75102]:   </features>
Nov 10 16:27:04 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:27:04 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:27:04 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:27:04 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:27:04 user nova-compute[75102]:   </clock>
Nov 10 16:27:04 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:27:04 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:27:04 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:27:04 user nova-compute[75102]:   </cpu>
Nov 10 16:27:04 user nova-compute[75102]:   <devices>
Nov 10 16:27:04 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:27:04 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:27:04 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk"/>
Nov 10 16:27:04 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:27:04 user nova-compute[75102]:     </disk>
Nov 10 16:27:04 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:27:04 user nova-compute[75102]:       <mac address="fa:16:3e:f5:5c:67"/>
Nov 10 16:27:04 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:27:04 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:27:04 user nova-compute[75102]:       <target dev="tap75115f2e-23"/>
Nov 10 16:27:04 user nova-compute[75102]:     </interface>
Nov 10 16:27:04 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:27:04 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/console.log" append="off"/>
Nov 10 16:27:04 user nova-compute[75102]:     </serial>
Nov 10 16:27:04 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:27:04 user nova-compute[75102]:     <video>
Nov 10 16:27:04 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:27:04 user nova-compute[75102]:     </video>
Nov 10 16:27:04 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:27:04 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:27:04 user nova-compute[75102]:     </rng>
Nov 10 16:27:04 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:27:04 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:27:04 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:27:04 user nova-compute[75102]:     </memballoon>
Nov 10 16:27:04 user nova-compute[75102]:   </devices>
Nov 10 16:27:04 user nova-compute[75102]: </domain>
Nov 10 16:27:04 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-329465846',display_name='tempest-VolumesNegativeTest-instance-329465846',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-329465846',id=24,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='584ee1f0e06a4b0e99a0dba965541b18',ramdisk_id='',reservation_id='r-tagvtw6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-777079920',owner_user_name='tempest-VolumesNegativeTest-777079920-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:27:02Z,user_data=None,user_id='ca09662ed2434005b610a4b2366c3a96',uuid=3f64688a-b3db-4879-81f9-0a35923aae42,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "address": "fa:16:3e:f5:5c:67", "network": {"id": "06ba9c71-267c-4c62-9154-c6835b7b274a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "27ab322133744b01aba75af5d356371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75115f2e-23", "ovs_interfaceid": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Converting VIF {"id": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "address": "fa:16:3e:f5:5c:67", "network": {"id": "06ba9c71-267c-4c62-9154-c6835b7b274a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "27ab322133744b01aba75af5d356371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75115f2e-23", "ovs_interfaceid": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:67,bridge_name='br-int',has_traffic_filtering=True,id=75115f2e-2399-4cc5-8a58-84ea4e3501e1,network=Network(06ba9c71-267c-4c62-9154-c6835b7b274a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75115f2e-23') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG os_vif [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:67,bridge_name='br-int',has_traffic_filtering=True,id=75115f2e-2399-4cc5-8a58-84ea4e3501e1,network=Network(06ba9c71-267c-4c62-9154-c6835b7b274a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75115f2e-23') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4a47bb2b-56be-5200-8023-f06af59f5cd1', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.objects.instance [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'flavor' on Instance uuid a437e642-d3a4-4356-805e-cb68da21167f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75115f2e-23, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap75115f2e-23, col_values=(('qos', UUID('8e02cab1-0bcf-4ccf-b0c6-d8a9f2e51bd3')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap75115f2e-23, col_values=(('external_ids', {'iface-id': '75115f2e-2399-4cc5-8a58-84ea4e3501e1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f5:5c:67', 'vm-uuid': '3f64688a-b3db-4879-81f9-0a35923aae42'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:27:04 user nova-compute[75102]: INFO os_vif [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:67,bridge_name='br-int',has_traffic_filtering=True,id=75115f2e-2399-4cc5-8a58-84ea4e3501e1,network=Network(06ba9c71-267c-4c62-9154-c6835b7b274a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75115f2e-23')
Nov 10 16:27:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.138s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.096s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:04 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] No VIF found with MAC fa:16:3e:f5:5c:67, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:05 user nova-compute[75102]: INFO nova.compute.manager [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Attaching volume fff14467-130d-43cf-a2ef-bb01708add8f to /dev/vdb
Nov 10 16:27:05 user nova-compute[75102]: DEBUG os_brick.utils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebe12cf-123b-49f3-8e12-51c83fdc8622]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.033s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b41d4091-776a-46e0-8eff-4808b5f790d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff08f073-d14c-4a28-be25-026c90c40a06]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c668fa-9ea0-449c-acd5-85919943d1b7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:27:05 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:27:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ca7167-ad00-4d3e-ab17-affd8d3f982b]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG os_brick.utils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] <== get_connector_properties: return (171ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:27:05 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Updating existing volume attachment record: 9d1344f5-094a-462e-b508-7598b1ff2668 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:27:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-86ac6cae-2891-4e93-8ea3-ea818091d3c1 req-bde6f272-6826-4368-a633-1f7417e9c65e service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received event network-vif-plugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-86ac6cae-2891-4e93-8ea3-ea818091d3c1 req-bde6f272-6826-4368-a633-1f7417e9c65e service nova] Acquiring lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-86ac6cae-2891-4e93-8ea3-ea818091d3c1 req-bde6f272-6826-4368-a633-1f7417e9c65e service nova] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-86ac6cae-2891-4e93-8ea3-ea818091d3c1 req-bde6f272-6826-4368-a633-1f7417e9c65e service nova] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-86ac6cae-2891-4e93-8ea3-ea818091d3c1 req-bde6f272-6826-4368-a633-1f7417e9c65e service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] No waiting events found dispatching network-vif-plugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:27:06 user nova-compute[75102]: WARNING nova.compute.manager [req-86ac6cae-2891-4e93-8ea3-ea818091d3c1 req-bde6f272-6826-4368-a633-1f7417e9c65e service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received unexpected event network-vif-plugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 for instance with vm_state building and task_state spawning.
Nov 10 16:27:07 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:27:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-e38f6376-1856-4466-8cb3-a5b4472d6aba req-7e0881ee-766f-46bc-9227-3f695e5a488a service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received event network-vif-plugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e38f6376-1856-4466-8cb3-a5b4472d6aba req-7e0881ee-766f-46bc-9227-3f695e5a488a service nova] Acquiring lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e38f6376-1856-4466-8cb3-a5b4472d6aba req-7e0881ee-766f-46bc-9227-3f695e5a488a service nova] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e38f6376-1856-4466-8cb3-a5b4472d6aba req-7e0881ee-766f-46bc-9227-3f695e5a488a service nova] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-e38f6376-1856-4466-8cb3-a5b4472d6aba req-7e0881ee-766f-46bc-9227-3f695e5a488a service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] No waiting events found dispatching network-vif-plugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:27:09 user nova-compute[75102]: WARNING nova.compute.manager [req-e38f6376-1856-4466-8cb3-a5b4472d6aba req-7e0881ee-766f-46bc-9227-3f695e5a488a service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received unexpected event network-vif-plugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 for instance with vm_state building and task_state spawning.
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:27:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Instance spawned successfully.
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:09 user nova-compute[75102]: INFO nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Took 7.23 seconds to spawn the instance on the hypervisor.
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:09 user nova-compute[75102]: INFO nova.compute.manager [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Took 8.75 seconds to build instance.
Nov 10 16:27:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0c354071-795b-40df-a8b8-88d131313694 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "3f64688a-b3db-4879-81f9-0a35923aae42" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.883s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:09 user nova-compute[75102]: INFO nova.compute.manager [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] instance snapshotting
Nov 10 16:27:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Beginning live snapshot process
Nov 10 16:27:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json -f qcow2 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.244s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json -f qcow2 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json -f qcow2" returned: 0 in 0.263s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.243s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpngwyydjm/f92dd684a95940de8accc005c9df65f0.delta 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpngwyydjm/f92dd684a95940de8accc005c9df65f0.delta 1073741824" returned: 0 in 0.061s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 16:27:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:27:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:27:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 16:27:12 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:27:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpngwyydjm/f92dd684a95940de8accc005c9df65f0.delta /opt/stack/data/nova/instances/snapshots/tmpngwyydjm/f92dd684a95940de8accc005c9df65f0 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpngwyydjm/f92dd684a95940de8accc005c9df65f0.delta /opt/stack/data/nova/instances/snapshots/tmpngwyydjm/f92dd684a95940de8accc005c9df65f0" returned: 0 in 0.474s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Snapshot extracted, beginning image upload
Nov 10 16:27:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:14 user nova-compute[75102]: INFO nova.compute.manager [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Terminating instance
Nov 10 16:27:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-72279bbf-cde1-4fa1-8fc9-05c66216c293 req-3e08a8f9-2f0c-496d-b62f-0b186e1a8f3b service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-unplugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-72279bbf-cde1-4fa1-8fc9-05c66216c293 req-3e08a8f9-2f0c-496d-b62f-0b186e1a8f3b service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-72279bbf-cde1-4fa1-8fc9-05c66216c293 req-3e08a8f9-2f0c-496d-b62f-0b186e1a8f3b service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-72279bbf-cde1-4fa1-8fc9-05c66216c293 req-3e08a8f9-2f0c-496d-b62f-0b186e1a8f3b service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-72279bbf-cde1-4fa1-8fc9-05c66216c293 req-3e08a8f9-2f0c-496d-b62f-0b186e1a8f3b service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-unplugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-72279bbf-cde1-4fa1-8fc9-05c66216c293 req-3e08a8f9-2f0c-496d-b62f-0b186e1a8f3b service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-unplugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:27:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Instance destroyed successfully.
Nov 10 16:27:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lazy-loading 'resources' on Instance uuid 731624eb-b0c0-42c1-80cf-2dd76932e92a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:56Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-1376797735',display_name='tempest-ServerActionsTestOtherB-server-1376797735',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-1376797735',id=3,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjHr0jwe70jfLAKGRmlC9Z1xJ9zp5YI31PlNstF6fiupDKXJEjbBPAkoJ7zXlYnnaeafbpydLq7gUD5yOQPm6w6xcEQdooK67LWtISX7OzOkN1IUKn+FbDIXcoKGGroQQ==',key_name='tempest-keypair-1977714077',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:25:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7d5f31d051084698bce41a77bc9faa87',ramdisk_id='',reservation_id='r-gdlg319g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-792699016',owner_user_name='tempest-ServerActionsTestOtherB-792699016-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:25:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8fb6cbfdc7334af4a5e4cae046d2e6b1',uuid=731624eb-b0c0-42c1-80cf-2dd76932e92a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converting VIF {"id": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "address": "fa:16:3e:f8:94:15", "network": {"id": "c9256d5b-9726-401f-aaf9-ba23cd79f173", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-884003894-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.248", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7d5f31d051084698bce41a77bc9faa87", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73a78287-ce", "ovs_interfaceid": "73a78287-ce4f-4bf1-b9aa-e5eecbc4a608", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_vif [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73a78287-ce, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f7116d09-fbfb-414c-a1a5-0a7e7e9d7f97) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:27:15 user nova-compute[75102]: INFO os_vif [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f8:94:15,bridge_name='br-int',has_traffic_filtering=True,id=73a78287-ce4f-4bf1-b9aa-e5eecbc4a608,network=Network(c9256d5b-9726-401f-aaf9-ba23cd79f173),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73a78287-ce')
Nov 10 16:27:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ClnYeBIV', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:27:15 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b202c7-5d54-4151-8d9b-7969732ed029]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:27:15 user nova-compute[75102]: No targets found.
Nov 10 16:27:15 user nova-compute[75102]: iSNS:
Nov 10 16:27:15 user nova-compute[75102]: No targets found.
Nov 10 16:27:15 user nova-compute[75102]: STATIC:
Nov 10 16:27:15 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881
Nov 10 16:27:15 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:27:15 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:27:15 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:27:15 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:27:15 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:27:15 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788
Nov 10 16:27:15 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:27:15 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:27:15 user nova-compute[75102]: FIRMWARE:
Nov 10 16:27:15 user nova-compute[75102]: No targets found.
Nov 10 16:27:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:27:15 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:27:15 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[444aba29-a5d5-449a-bc99-ed6adc771be6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c336e6-93a8-4edc-8ec2-89ea94c536cb]: (4, ('tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:27:15 user nova-compute[75102]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:27:15 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:27:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsi session list stdout=tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 (non-flash)
Nov 10 16:27:15 user nova-compute[75102]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:27:15 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:27:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f8435cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[88e49ba7-0643-4a57-bb7d-0e1c283852f5]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[09db808e-2190-4249-bcfc-f8b38b4fafb0]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[294c7ceb-b43b-44d1-9f8b-f2afa014d5b6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.055s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[06795bcf-65d8-4c82-a8fc-e8794ba51068]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c41b4b4-a6ad-4c8c-b7cc-ad2ad370902b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[983432a1-fa8a-4d5f-ace4-a8727904722d]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260]
Nov 10 16:27:15 user nova-compute[75102]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788, portal: 172.16.0.220,3260] successful.
Nov 10 16:27:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:16c3c027-57d4-46aa-a334-ac1fbdf77788 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[375d9af1-4ee7-4857-9258-4bf0b3865624]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.370s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] <== disconnect_volume: return (372ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:27:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Deleting instance files /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a_del
Nov 10 16:27:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Deletion of /opt/stack/data/nova/instances/731624eb-b0c0-42c1-80cf-2dd76932e92a_del complete
Nov 10 16:27:15 user nova-compute[75102]: INFO nova.compute.manager [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Took 1.58 seconds to destroy the instance on the hypervisor.
Nov 10 16:27:15 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:27:15 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:27:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Snapshot image upload complete
Nov 10 16:27:16 user nova-compute[75102]: INFO nova.compute.manager [None req-c87f7a3d-f6ed-4f99-967a-9136fbe40c92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Took 6.59 seconds to snapshot the instance on the hypervisor.
Nov 10 16:27:16 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:16 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Took 0.89 seconds to deallocate network for instance.
Nov 10 16:27:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-92583b59-a75f-4072-b63e-b3e475a674bd req-0cf30819-2289-42f6-b202-54cbb8ad0fd3 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-92583b59-a75f-4072-b63e-b3e475a674bd req-0cf30819-2289-42f6-b202-54cbb8ad0fd3 service nova] Acquiring lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-92583b59-a75f-4072-b63e-b3e475a674bd req-0cf30819-2289-42f6-b202-54cbb8ad0fd3 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-92583b59-a75f-4072-b63e-b3e475a674bd req-0cf30819-2289-42f6-b202-54cbb8ad0fd3 service nova] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-92583b59-a75f-4072-b63e-b3e475a674bd req-0cf30819-2289-42f6-b202-54cbb8ad0fd3 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] No waiting events found dispatching network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:27:16 user nova-compute[75102]: WARNING nova.compute.manager [req-92583b59-a75f-4072-b63e-b3e475a674bd req-0cf30819-2289-42f6-b202-54cbb8ad0fd3 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received unexpected event network-vif-plugged-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 for instance with vm_state active and task_state deleting.
Nov 10 16:27:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-92583b59-a75f-4072-b63e-b3e475a674bd req-0cf30819-2289-42f6-b202-54cbb8ad0fd3 service nova] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Received event network-vif-deleted-73a78287-ce4f-4bf1-b9aa-e5eecbc4a608 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:17 user nova-compute[75102]: INFO nova.compute.manager [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] [instance: 731624eb-b0c0-42c1-80cf-2dd76932e92a] Took 1.06 seconds to detach 1 volumes for instance.
Nov 10 16:27:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:18 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:27:18 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:27:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.478s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:18 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Deleted allocations for instance 731624eb-b0c0-42c1-80cf-2dd76932e92a
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.volume.cinder [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Update attachment failed for attachment a3323518-8ba7-43bf-801e-971a57efaea3. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8d958c1d-1521-4483-ab8a-e5319d2e9f1f) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8d958c1d-1521-4483-ab8a-e5319d2e9f1f)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Instance failed block device setup: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8d958c1d-1521-4483-ab8a-e5319d2e9f1f)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Traceback (most recent call last):
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     driver_block_device.attach_block_devices(
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     _log_and_attach(device)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     self._volume_attach(context, volume, connector, instance,
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     connection_info = volume_api.attachment_update(
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     res = method(self, ctx, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     with excutils.save_and_reraise_exception():
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     self.force_reraise()
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     raise self.value
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     return method.func(obj, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     return self.request(url, method, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e]     raise exceptions.from_response(resp, body)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8d958c1d-1521-4483-ab8a-e5319d2e9f1f)
Nov 10 16:27:18 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] 
Nov 10 16:27:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "3f35d18d-c23d-4628-80e7-52e0288fc39e" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 19.063s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3cfa7e09-07d3-42a9-bf23-369196bdaf40 tempest-ServerActionsTestOtherB-792699016 tempest-ServerActionsTestOtherB-792699016-project-member] Lock "731624eb-b0c0-42c1-80cf-2dd76932e92a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.252s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:18 user nova-compute[75102]: INFO nova.compute.manager [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 3f35d18d-c23d-4628-80e7-52e0288fc39e] Successfully reverted task state from spawning on failure for instance.
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server [None req-ea9716f5-8791-4d52-9d45-7f7030541b06 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Exception during message handling: nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8d958c1d-1521-4483-ab8a-e5319d2e9f1f)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2190, in _prep_block_device
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     driver_block_device.attach_block_devices(
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 936, in attach_block_devices
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     _log_and_attach(device)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 933, in _log_and_attach
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     bdm.attach(*attach_args, **attach_kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8d958c1d-1521-4483-ab8a-e5319d2e9f1f)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred:
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 166, in decorated_function
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 157, in decorated_function
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7083, in unshelve_instance
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     do_unshelve_instance()
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7080, in do_unshelve_instance
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._unshelve_instance(
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7112, in _unshelve_instance
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     block_device_info = self._prep_block_device(context, instance, bdms)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 2209, in _prep_block_device
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise exception.InvalidBDM(str(ex))
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server nova.exception.InvalidBDM: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-8d958c1d-1521-4483-ab8a-e5319d2e9f1f)
Nov 10 16:27:18 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:27:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:27:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQdahjWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:27:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:27:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:27:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:27:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:27:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:27:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:27:31 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:27:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ea09413-a181-4f39-979c-5584eab3394a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:27:31 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7180fce-4a34-4a85-94de-ffe87fdc2268]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f] added
Nov 10 16:27:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0cf6db-5efb-4bc6-b8e5-1d53b612452d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c09c1c1-5216-44c4-a84c-c3170007fc59]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQdahjWJ {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v nQdahjWJ" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[10fb7e9b-5953-4f41-b54a-eb8f6afa1047]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'nQdahjWJ'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b8bfd3-7f6e-451e-932a-bcb462423a77]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3aa4f597-9684-464b-ba84-129f68c06fbe]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:27:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:27:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:27:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:27:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[186043db-5d56-4d3b-8560-5b8fe3f7c256]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f, portal: 172.16.0.220,3260]
Nov 10 16:27:32 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f, portal: 172.16.0.220,3260] successful.
Nov 10 16:27:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb04a8ee-35da-4fc6-bae4-e84c7a39eedb]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e89c9b1b-ff99-438a-bf6a-5d7e49afa46e]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:27:32 user nova-compute[75102]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:27:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:27:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:27:32 user nova-compute[75102]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:27:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:27:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] HCTL ('34', '-', '-', 0) found on session 21 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc77a7cc-6e67-454c-bd91-cf871692ed65]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching for a device in session 21 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:27:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQdahjWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:27:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:27:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '23237626166323838', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:27:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23237626166323838', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:27:33 user nova-compute[75102]: DEBUG nova.objects.instance [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'flavor' on Instance uuid a437e642-d3a4-4356-805e-cb68da21167f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:27:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:27:33 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:27:33 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:27:33 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:27:33 user nova-compute[75102]:   <serial>fff14467-130d-43cf-a2ef-bb01708add8f</serial>
Nov 10 16:27:33 user nova-compute[75102]: </disk>
Nov 10 16:27:33 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:27:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:27:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:27:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No VIF found with MAC fa:16:3e:ab:a7:19, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:27:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e2a91458-5193-450f-b6ba-643d89bd1e47 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.742s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:27:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:34 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:27:34 user nova-compute[75102]: INFO nova.compute.claims [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Claim successful on node user
Nov 10 16:27:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.628s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG nova.network.neutron [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:27:35 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:27:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG nova.policy [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1c97d44d1a1a4d3ba6f7e4f7f57dcbee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2bfa048a64b74cef84d4645eb627c0eb', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:27:35 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Creating image(s)
Nov 10 16:27:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "/opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "/opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "/opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.230s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG nova.network.neutron [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Successfully created port: 2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk 1073741824" returned: 0 in 0.077s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.316s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.188s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Cannot resize image /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Ensure instance console log exists: /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.network.neutron [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Successfully updated port: 2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "refresh_cache-ede4b1ad-5bee-498e-8692-08b00dfa323a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquired lock "refresh_cache-ede4b1ad-5bee-498e-8692-08b00dfa323a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.network.neutron [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-8aef6ee8-a323-4c4c-a746-9aa300c86094 req-ae646325-a12d-4f7d-b3ea-2d2c1945c79a service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-changed-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-8aef6ee8-a323-4c4c-a746-9aa300c86094 req-ae646325-a12d-4f7d-b3ea-2d2c1945c79a service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Refreshing instance network info cache due to event network-changed-2c8f706a-9786-4b8d-b2cf-d8b80210abb5. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aef6ee8-a323-4c4c-a746-9aa300c86094 req-ae646325-a12d-4f7d-b3ea-2d2c1945c79a service nova] Acquiring lock "refresh_cache-ede4b1ad-5bee-498e-8692-08b00dfa323a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.network.neutron [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.network.neutron [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Updating instance_info_cache with network_info: [{"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Releasing lock "refresh_cache-ede4b1ad-5bee-498e-8692-08b00dfa323a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Instance network_info: |[{"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aef6ee8-a323-4c4c-a746-9aa300c86094 req-ae646325-a12d-4f7d-b3ea-2d2c1945c79a service nova] Acquired lock "refresh_cache-ede4b1ad-5bee-498e-8692-08b00dfa323a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.network.neutron [req-8aef6ee8-a323-4c4c-a746-9aa300c86094 req-ae646325-a12d-4f7d-b3ea-2d2c1945c79a service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Refreshing network info cache for port 2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Start _get_guest_xml network_info=[{"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:27:37 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:27:37 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-650362378',display_name='tempest-VolumesActionsTest-instance-650362378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-650362378',id=25,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bfa048a64b74cef84d4645eb627c0eb',ramdisk_id='',reservation_id='r-5rxk0vfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-880387838',owner_user_name='tempest-VolumesActionsTest-880387838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:27:36Z,user_data=None,user_id='1c97d44d1a1a4d3ba6f7e4f7f57dcbee',uuid=ede4b1ad-5bee-498e-8692-08b00dfa323a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converting VIF {"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5e:49,bridge_name='br-int',has_traffic_filtering=True,id=2c8f706a-9786-4b8d-b2cf-d8b80210abb5,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f706a-97') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.objects.instance [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lazy-loading 'pci_devices' on Instance uuid ede4b1ad-5bee-498e-8692-08b00dfa323a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:27:37 user nova-compute[75102]:   <uuid>ede4b1ad-5bee-498e-8692-08b00dfa323a</uuid>
Nov 10 16:27:37 user nova-compute[75102]:   <name>instance-00000019</name>
Nov 10 16:27:37 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:27:37 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:27:37 user nova-compute[75102]:   <metadata>
Nov 10 16:27:37 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:27:37 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:27:37 user nova-compute[75102]:       <nova:name>tempest-VolumesActionsTest-instance-650362378</nova:name>
Nov 10 16:27:37 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:27:37</nova:creationTime>
Nov 10 16:27:37 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:27:37 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:27:37 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:27:37 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:27:37 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:27:37 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:27:37 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:27:37 user nova-compute[75102]:       <nova:owner>
Nov 10 16:27:37 user nova-compute[75102]:         <nova:user uuid="1c97d44d1a1a4d3ba6f7e4f7f57dcbee">tempest-VolumesActionsTest-880387838-project-member</nova:user>
Nov 10 16:27:37 user nova-compute[75102]:         <nova:project uuid="2bfa048a64b74cef84d4645eb627c0eb">tempest-VolumesActionsTest-880387838</nova:project>
Nov 10 16:27:37 user nova-compute[75102]:       </nova:owner>
Nov 10 16:27:37 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:27:37 user nova-compute[75102]:       <nova:ports>
Nov 10 16:27:37 user nova-compute[75102]:         <nova:port uuid="2c8f706a-9786-4b8d-b2cf-d8b80210abb5">
Nov 10 16:27:37 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 16:27:37 user nova-compute[75102]:         </nova:port>
Nov 10 16:27:37 user nova-compute[75102]:       </nova:ports>
Nov 10 16:27:37 user nova-compute[75102]:     </nova:instance>
Nov 10 16:27:37 user nova-compute[75102]:   </metadata>
Nov 10 16:27:37 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:27:37 user nova-compute[75102]:     <system>
Nov 10 16:27:37 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:27:37 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:27:37 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:27:37 user nova-compute[75102]:       <entry name="serial">ede4b1ad-5bee-498e-8692-08b00dfa323a</entry>
Nov 10 16:27:37 user nova-compute[75102]:       <entry name="uuid">ede4b1ad-5bee-498e-8692-08b00dfa323a</entry>
Nov 10 16:27:37 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:27:37 user nova-compute[75102]:     </system>
Nov 10 16:27:37 user nova-compute[75102]:   </sysinfo>
Nov 10 16:27:37 user nova-compute[75102]:   <os>
Nov 10 16:27:37 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:27:37 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:27:37 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:27:37 user nova-compute[75102]:   </os>
Nov 10 16:27:37 user nova-compute[75102]:   <features>
Nov 10 16:27:37 user nova-compute[75102]:     <acpi/>
Nov 10 16:27:37 user nova-compute[75102]:     <apic/>
Nov 10 16:27:37 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:27:37 user nova-compute[75102]:   </features>
Nov 10 16:27:37 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:27:37 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:27:37 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:27:37 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:27:37 user nova-compute[75102]:   </clock>
Nov 10 16:27:37 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:27:37 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:27:37 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:27:37 user nova-compute[75102]:   </cpu>
Nov 10 16:27:37 user nova-compute[75102]:   <devices>
Nov 10 16:27:37 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:27:37 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:27:37 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk"/>
Nov 10 16:27:37 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:27:37 user nova-compute[75102]:     </disk>
Nov 10 16:27:37 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:27:37 user nova-compute[75102]:       <mac address="fa:16:3e:b1:5e:49"/>
Nov 10 16:27:37 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:27:37 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:27:37 user nova-compute[75102]:       <target dev="tap2c8f706a-97"/>
Nov 10 16:27:37 user nova-compute[75102]:     </interface>
Nov 10 16:27:37 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:27:37 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/console.log" append="off"/>
Nov 10 16:27:37 user nova-compute[75102]:     </serial>
Nov 10 16:27:37 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:27:37 user nova-compute[75102]:     <video>
Nov 10 16:27:37 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:27:37 user nova-compute[75102]:     </video>
Nov 10 16:27:37 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:27:37 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:27:37 user nova-compute[75102]:     </rng>
Nov 10 16:27:37 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:27:37 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:27:37 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:27:37 user nova-compute[75102]:     </memballoon>
Nov 10 16:27:37 user nova-compute[75102]:   </devices>
Nov 10 16:27:37 user nova-compute[75102]: </domain>
Nov 10 16:27:37 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-650362378',display_name='tempest-VolumesActionsTest-instance-650362378',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-650362378',id=25,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2bfa048a64b74cef84d4645eb627c0eb',ramdisk_id='',reservation_id='r-5rxk0vfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-880387838',owner_user_name='tempest-VolumesActionsTest-880387838-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:27:36Z,user_data=None,user_id='1c97d44d1a1a4d3ba6f7e4f7f57dcbee',uuid=ede4b1ad-5bee-498e-8692-08b00dfa323a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converting VIF {"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5e:49,bridge_name='br-int',has_traffic_filtering=True,id=2c8f706a-9786-4b8d-b2cf-d8b80210abb5,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f706a-97') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG os_vif [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5e:49,bridge_name='br-int',has_traffic_filtering=True,id=2c8f706a-9786-4b8d-b2cf-d8b80210abb5,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f706a-97') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '384fc542-e424-531e-b4e2-d30c6c68f189', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2c8f706a-97, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2c8f706a-97, col_values=(('qos', UUID('d3417753-3eaa-42e2-9439-c2c315fe4f28')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2c8f706a-97, col_values=(('external_ids', {'iface-id': '2c8f706a-9786-4b8d-b2cf-d8b80210abb5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:5e:49', 'vm-uuid': 'ede4b1ad-5bee-498e-8692-08b00dfa323a'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:37 user nova-compute[75102]: INFO os_vif [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5e:49,bridge_name='br-int',has_traffic_filtering=True,id=2c8f706a-9786-4b8d-b2cf-d8b80210abb5,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f706a-97')
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] No VIF found with MAC fa:16:3e:b1:5e:49, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:37 user nova-compute[75102]: DEBUG nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:27:38 user nova-compute[75102]: INFO nova.compute.claims [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Claim successful on node user
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.network.neutron [req-8aef6ee8-a323-4c4c-a746-9aa300c86094 req-ae646325-a12d-4f7d-b3ea-2d2c1945c79a service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Updated VIF entry in instance network info cache for port 2c8f706a-9786-4b8d-b2cf-d8b80210abb5. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.network.neutron [req-8aef6ee8-a323-4c4c-a746-9aa300c86094 req-ae646325-a12d-4f7d-b3ea-2d2c1945c79a service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Updating instance_info_cache with network_info: [{"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8aef6ee8-a323-4c4c-a746-9aa300c86094 req-ae646325-a12d-4f7d-b3ea-2d2c1945c79a service nova] Releasing lock "refresh_cache-ede4b1ad-5bee-498e-8692-08b00dfa323a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.network.neutron [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:27:38 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.policy [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e290c40d1bac47f9aa06185efefbb4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e388a924d2546fabfefe82c241ecbb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:27:38 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Creating image(s)
Nov 10 16:27:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "/opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "/opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "/opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.188s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk 1073741824" returned: 0 in 0.060s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.252s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.206s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-44e689bb-e940-4132-965a-9f06f0d71ab8 req-7b5d6939-3e41-46ed-b2c6-19b59a3e3077 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-44e689bb-e940-4132-965a-9f06f0d71ab8 req-7b5d6939-3e41-46ed-b2c6-19b59a3e3077 service nova] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-44e689bb-e940-4132-965a-9f06f0d71ab8 req-7b5d6939-3e41-46ed-b2c6-19b59a3e3077 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-44e689bb-e940-4132-965a-9f06f0d71ab8 req-7b5d6939-3e41-46ed-b2c6-19b59a3e3077 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-44e689bb-e940-4132-965a-9f06f0d71ab8 req-7b5d6939-3e41-46ed-b2c6-19b59a3e3077 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] No waiting events found dispatching network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:27:39 user nova-compute[75102]: WARNING nova.compute.manager [req-44e689bb-e940-4132-965a-9f06f0d71ab8 req-7b5d6939-3e41-46ed-b2c6-19b59a3e3077 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received unexpected event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 for instance with vm_state building and task_state spawning.
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Cannot resize image /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Ensure instance console log exists: /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG nova.network.neutron [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Successfully created port: 02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG nova.network.neutron [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Successfully updated port: 02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "refresh_cache-8fbbb791-da59-44ba-997c-0b0ff3957539" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquired lock "refresh_cache-8fbbb791-da59-44ba-997c-0b0ff3957539" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG nova.network.neutron [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG nova.network.neutron [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG nova.network.neutron [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Updating instance_info_cache with network_info: [{"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Releasing lock "refresh_cache-8fbbb791-da59-44ba-997c-0b0ff3957539" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Instance network_info: |[{"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:27:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Start _get_guest_xml network_info=[{"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:27:40 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:27:40 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1594019203',display_name='tempest-AttachVolumeNegativeTest-server-1594019203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1594019203',id=26,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeW+FNwj9Ik+g8BSr/64AeFFcNYUfvateMePx/nJBwIlFaG2NXTbrZYcADg64M973SfPXXJdQPCcFL7vZNvrshUqwdhwKs0m3b9YXDge4pD2y+g68kRaN4Jn+rAoxb1Nw==',key_name='tempest-keypair-493807276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-1dux8wyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=8fbbb791-da59-44ba-997c-0b0ff3957539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=02c4e33c-815c-4ffb-bdd0-3bade65e8345,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c4e33c-81') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.objects.instance [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'pci_devices' on Instance uuid 8fbbb791-da59-44ba-997c-0b0ff3957539 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:27:41 user nova-compute[75102]:   <uuid>8fbbb791-da59-44ba-997c-0b0ff3957539</uuid>
Nov 10 16:27:41 user nova-compute[75102]:   <name>instance-0000001a</name>
Nov 10 16:27:41 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:27:41 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:27:41 user nova-compute[75102]:   <metadata>
Nov 10 16:27:41 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:27:41 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:27:41 user nova-compute[75102]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1594019203</nova:name>
Nov 10 16:27:41 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:27:40</nova:creationTime>
Nov 10 16:27:41 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:27:41 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:27:41 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:27:41 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:27:41 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:27:41 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:27:41 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:27:41 user nova-compute[75102]:       <nova:owner>
Nov 10 16:27:41 user nova-compute[75102]:         <nova:user uuid="e290c40d1bac47f9aa06185efefbb4bd">tempest-AttachVolumeNegativeTest-1745402198-project-member</nova:user>
Nov 10 16:27:41 user nova-compute[75102]:         <nova:project uuid="6e388a924d2546fabfefe82c241ecbb1">tempest-AttachVolumeNegativeTest-1745402198</nova:project>
Nov 10 16:27:41 user nova-compute[75102]:       </nova:owner>
Nov 10 16:27:41 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:27:41 user nova-compute[75102]:       <nova:ports>
Nov 10 16:27:41 user nova-compute[75102]:         <nova:port uuid="02c4e33c-815c-4ffb-bdd0-3bade65e8345">
Nov 10 16:27:41 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 16:27:41 user nova-compute[75102]:         </nova:port>
Nov 10 16:27:41 user nova-compute[75102]:       </nova:ports>
Nov 10 16:27:41 user nova-compute[75102]:     </nova:instance>
Nov 10 16:27:41 user nova-compute[75102]:   </metadata>
Nov 10 16:27:41 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:27:41 user nova-compute[75102]:     <system>
Nov 10 16:27:41 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:27:41 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:27:41 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:27:41 user nova-compute[75102]:       <entry name="serial">8fbbb791-da59-44ba-997c-0b0ff3957539</entry>
Nov 10 16:27:41 user nova-compute[75102]:       <entry name="uuid">8fbbb791-da59-44ba-997c-0b0ff3957539</entry>
Nov 10 16:27:41 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:27:41 user nova-compute[75102]:     </system>
Nov 10 16:27:41 user nova-compute[75102]:   </sysinfo>
Nov 10 16:27:41 user nova-compute[75102]:   <os>
Nov 10 16:27:41 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:27:41 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:27:41 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:27:41 user nova-compute[75102]:   </os>
Nov 10 16:27:41 user nova-compute[75102]:   <features>
Nov 10 16:27:41 user nova-compute[75102]:     <acpi/>
Nov 10 16:27:41 user nova-compute[75102]:     <apic/>
Nov 10 16:27:41 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:27:41 user nova-compute[75102]:   </features>
Nov 10 16:27:41 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:27:41 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:27:41 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:27:41 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:27:41 user nova-compute[75102]:   </clock>
Nov 10 16:27:41 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:27:41 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:27:41 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:27:41 user nova-compute[75102]:   </cpu>
Nov 10 16:27:41 user nova-compute[75102]:   <devices>
Nov 10 16:27:41 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:27:41 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:27:41 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk"/>
Nov 10 16:27:41 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:27:41 user nova-compute[75102]:     </disk>
Nov 10 16:27:41 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:27:41 user nova-compute[75102]:       <mac address="fa:16:3e:e1:3f:c3"/>
Nov 10 16:27:41 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:27:41 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:27:41 user nova-compute[75102]:       <target dev="tap02c4e33c-81"/>
Nov 10 16:27:41 user nova-compute[75102]:     </interface>
Nov 10 16:27:41 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:27:41 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/console.log" append="off"/>
Nov 10 16:27:41 user nova-compute[75102]:     </serial>
Nov 10 16:27:41 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:27:41 user nova-compute[75102]:     <video>
Nov 10 16:27:41 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:27:41 user nova-compute[75102]:     </video>
Nov 10 16:27:41 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:27:41 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:27:41 user nova-compute[75102]:     </rng>
Nov 10 16:27:41 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:27:41 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:27:41 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:27:41 user nova-compute[75102]:     </memballoon>
Nov 10 16:27:41 user nova-compute[75102]:   </devices>
Nov 10 16:27:41 user nova-compute[75102]: </domain>
Nov 10 16:27:41 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1594019203',display_name='tempest-AttachVolumeNegativeTest-server-1594019203',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1594019203',id=26,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeW+FNwj9Ik+g8BSr/64AeFFcNYUfvateMePx/nJBwIlFaG2NXTbrZYcADg64M973SfPXXJdQPCcFL7vZNvrshUqwdhwKs0m3b9YXDge4pD2y+g68kRaN4Jn+rAoxb1Nw==',key_name='tempest-keypair-493807276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-1dux8wyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:27:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=8fbbb791-da59-44ba-997c-0b0ff3957539,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=02c4e33c-815c-4ffb-bdd0-3bade65e8345,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c4e33c-81') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG os_vif [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=02c4e33c-815c-4ffb-bdd0-3bade65e8345,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c4e33c-81') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2dcce65-e903-599b-a8f3-7c77d28fc082', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02c4e33c-81, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02c4e33c-81, col_values=(('qos', UUID('ca07438e-171f-45e5-b37e-774b48da65cf')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02c4e33c-81, col_values=(('external_ids', {'iface-id': '02c4e33c-815c-4ffb-bdd0-3bade65e8345', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e1:3f:c3', 'vm-uuid': '8fbbb791-da59-44ba-997c-0b0ff3957539'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:41 user nova-compute[75102]: INFO os_vif [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=02c4e33c-815c-4ffb-bdd0-3bade65e8345,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c4e33c-81')
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No VIF found with MAC fa:16:3e:e1:3f:c3, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:27:41 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Instance spawned successfully.
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:41 user nova-compute[75102]: INFO nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] No waiting events found dispatching network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:27:41 user nova-compute[75102]: WARNING nova.compute.manager [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received unexpected event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 for instance with vm_state building and task_state spawning.
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-changed-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Refreshing instance network info cache due to event network-changed-02c4e33c-815c-4ffb-bdd0-3bade65e8345. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] Acquiring lock "refresh_cache-8fbbb791-da59-44ba-997c-0b0ff3957539" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] Acquired lock "refresh_cache-8fbbb791-da59-44ba-997c-0b0ff3957539" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:27:41 user nova-compute[75102]: DEBUG nova.network.neutron [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Refreshing network info cache for port 02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:27:41 user nova-compute[75102]: INFO nova.compute.manager [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Took 6.84 seconds to build instance.
Nov 10 16:27:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2241554b-d23a-428c-b38b-530e6621c9f3 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.955s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG nova.network.neutron [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Updated VIF entry in instance network info cache for port 02c4e33c-815c-4ffb-bdd0-3bade65e8345. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG nova.network.neutron [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Updating instance_info_cache with network_info: [{"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-65ffb7e7-4c35-47b2-96d3-609f9adee5fc req-c18390c4-e197-4b5b-a0ab-d603992c25e2 service nova] Releasing lock "refresh_cache-8fbbb791-da59-44ba-997c-0b0ff3957539" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG nova.compute.manager [req-482f8c1c-d91f-4d32-900d-4cc4857cc9e9 req-18dbd114-0efc-4e79-b4d8-1ae071888e02 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-482f8c1c-d91f-4d32-900d-4cc4857cc9e9 req-18dbd114-0efc-4e79-b4d8-1ae071888e02 service nova] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-482f8c1c-d91f-4d32-900d-4cc4857cc9e9 req-18dbd114-0efc-4e79-b4d8-1ae071888e02 service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-482f8c1c-d91f-4d32-900d-4cc4857cc9e9 req-18dbd114-0efc-4e79-b4d8-1ae071888e02 service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG nova.compute.manager [req-482f8c1c-d91f-4d32-900d-4cc4857cc9e9 req-18dbd114-0efc-4e79-b4d8-1ae071888e02 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] No waiting events found dispatching network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:27:42 user nova-compute[75102]: WARNING nova.compute.manager [req-482f8c1c-d91f-4d32-900d-4cc4857cc9e9 req-18dbd114-0efc-4e79-b4d8-1ae071888e02 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received unexpected event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 for instance with vm_state building and task_state spawning.
Nov 10 16:27:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:27:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Instance spawned successfully.
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-3f84ffb2-7a3e-4921-9b92-32cc6813c16e req-e7be50d8-ef75-4e46-a12a-d88974a2b065 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3f84ffb2-7a3e-4921-9b92-32cc6813c16e req-e7be50d8-ef75-4e46-a12a-d88974a2b065 service nova] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3f84ffb2-7a3e-4921-9b92-32cc6813c16e req-e7be50d8-ef75-4e46-a12a-d88974a2b065 service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3f84ffb2-7a3e-4921-9b92-32cc6813c16e req-e7be50d8-ef75-4e46-a12a-d88974a2b065 service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-3f84ffb2-7a3e-4921-9b92-32cc6813c16e req-e7be50d8-ef75-4e46-a12a-d88974a2b065 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] No waiting events found dispatching network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:27:44 user nova-compute[75102]: WARNING nova.compute.manager [req-3f84ffb2-7a3e-4921-9b92-32cc6813c16e req-e7be50d8-ef75-4e46-a12a-d88974a2b065 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received unexpected event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 for instance with vm_state building and task_state spawning.
Nov 10 16:27:44 user nova-compute[75102]: INFO nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Took 6.04 seconds to spawn the instance on the hypervisor.
Nov 10 16:27:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:27:44 user nova-compute[75102]: INFO nova.compute.manager [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Took 6.96 seconds to build instance.
Nov 10 16:27:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bbef6cde-2184-48d2-92a6-f0a7c11366d1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.062s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:46 user nova-compute[75102]: DEBUG nova.compute.manager [req-a19d40c8-12e8-4d88-b22a-326ef668f88b req-574f9dd8-2350-49d6-8131-5b8df27ceba2 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Received event network-changed-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:46 user nova-compute[75102]: DEBUG nova.compute.manager [req-a19d40c8-12e8-4d88-b22a-326ef668f88b req-574f9dd8-2350-49d6-8131-5b8df27ceba2 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Refreshing instance network info cache due to event network-changed-9cb73dcc-ebbc-40a9-8375-49e8fd739c07. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:27:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a19d40c8-12e8-4d88-b22a-326ef668f88b req-574f9dd8-2350-49d6-8131-5b8df27ceba2 service nova] Acquiring lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:27:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a19d40c8-12e8-4d88-b22a-326ef668f88b req-574f9dd8-2350-49d6-8131-5b8df27ceba2 service nova] Acquired lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:27:46 user nova-compute[75102]: DEBUG nova.network.neutron [req-a19d40c8-12e8-4d88-b22a-326ef668f88b req-574f9dd8-2350-49d6-8131-5b8df27ceba2 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Refreshing network info cache for port 9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:27:47 user nova-compute[75102]: DEBUG nova.network.neutron [req-a19d40c8-12e8-4d88-b22a-326ef668f88b req-574f9dd8-2350-49d6-8131-5b8df27ceba2 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updated VIF entry in instance network info cache for port 9cb73dcc-ebbc-40a9-8375-49e8fd739c07. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:27:47 user nova-compute[75102]: DEBUG nova.network.neutron [req-a19d40c8-12e8-4d88-b22a-326ef668f88b req-574f9dd8-2350-49d6-8131-5b8df27ceba2 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updating instance_info_cache with network_info: [{"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a19d40c8-12e8-4d88-b22a-326ef668f88b req-574f9dd8-2350-49d6-8131-5b8df27ceba2 service nova] Releasing lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:51 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:52 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-efc18378-c498-4b87-84ab-1860aeb7db46 req-659cfcd6-4903-4504-8817-0c9a3827b500 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-efc18378-c498-4b87-84ab-1860aeb7db46 req-659cfcd6-4903-4504-8817-0c9a3827b500 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing instance network info cache due to event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-efc18378-c498-4b87-84ab-1860aeb7db46 req-659cfcd6-4903-4504-8817-0c9a3827b500 service nova] Acquiring lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-efc18378-c498-4b87-84ab-1860aeb7db46 req-659cfcd6-4903-4504-8817-0c9a3827b500 service nova] Acquired lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG nova.network.neutron [req-efc18378-c498-4b87-84ab-1860aeb7db46 req-659cfcd6-4903-4504-8817-0c9a3827b500 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG nova.network.neutron [req-efc18378-c498-4b87-84ab-1860aeb7db46 req-659cfcd6-4903-4504-8817-0c9a3827b500 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updated VIF entry in instance network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG nova.network.neutron [req-efc18378-c498-4b87-84ab-1860aeb7db46 req-659cfcd6-4903-4504-8817-0c9a3827b500 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updating instance_info_cache with network_info: [{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.181", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-efc18378-c498-4b87-84ab-1860aeb7db46 req-659cfcd6-4903-4504-8817-0c9a3827b500 service nova] Releasing lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG nova.compute.manager [req-4a0a3ea2-0e98-4fd4-9033-a9b06f2c1815 req-996b2607-d33f-4abb-bffb-82e89020df49 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG nova.compute.manager [req-4a0a3ea2-0e98-4fd4-9033-a9b06f2c1815 req-996b2607-d33f-4abb-bffb-82e89020df49 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing instance network info cache due to event network-changed-2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4a0a3ea2-0e98-4fd4-9033-a9b06f2c1815 req-996b2607-d33f-4abb-bffb-82e89020df49 service nova] Acquiring lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4a0a3ea2-0e98-4fd4-9033-a9b06f2c1815 req-996b2607-d33f-4abb-bffb-82e89020df49 service nova] Acquired lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-4a0a3ea2-0e98-4fd4-9033-a9b06f2c1815 req-996b2607-d33f-4abb-bffb-82e89020df49 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Refreshing network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:55 user nova-compute[75102]: INFO nova.compute.manager [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Detaching volume 47a37063-5d3a-443d-a66d-331b3fc1b881
Nov 10 16:27:55 user nova-compute[75102]: INFO nova.virt.block_device [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Attempting to driver detach volume 47a37063-5d3a-443d-a66d-331b3fc1b881 from mountpoint /dev/vdb
Nov 10 16:27:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Attempting to detach device vdb from instance b1ffa0dd-1f28-40f1-83e1-4a677302483c from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:27:55 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:27:55 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:27:55 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:27:55 user nova-compute[75102]:   <serial>47a37063-5d3a-443d-a66d-331b3fc1b881</serial>
Nov 10 16:27:55 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 16:27:55 user nova-compute[75102]: </disk>
Nov 10 16:27:55 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:27:55 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully detached device vdb from instance b1ffa0dd-1f28-40f1-83e1-4a677302483c from the persistent domain config.
Nov 10 16:27:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b1ffa0dd-1f28-40f1-83e1-4a677302483c from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:27:55 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:27:55 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:27:55 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:27:55 user nova-compute[75102]:   <serial>47a37063-5d3a-443d-a66d-331b3fc1b881</serial>
Nov 10 16:27:55 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 16:27:55 user nova-compute[75102]: </disk>
Nov 10 16:27:55 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-4a0a3ea2-0e98-4fd4-9033-a9b06f2c1815 req-996b2607-d33f-4abb-bffb-82e89020df49 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updated VIF entry in instance network info cache for port 2e6f20ff-75fe-49df-944c-ad4040cbdcb6. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-4a0a3ea2-0e98-4fd4-9033-a9b06f2c1815 req-996b2607-d33f-4abb-bffb-82e89020df49 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updating instance_info_cache with network_info: [{"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:27:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4a0a3ea2-0e98-4fd4-9033-a9b06f2c1815 req-996b2607-d33f-4abb-bffb-82e89020df49 service nova] Releasing lock "refresh_cache-b1ffa0dd-1f28-40f1-83e1-4a677302483c" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:27:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:27:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:27:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 16:27:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:27:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:27:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:27:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:27:58 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:27:58 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:27:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG nova.objects.instance [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'flavor' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:03 user nova-compute[75102]: INFO nova.compute.manager [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Attaching volume 856178a7-34e8-488b-9157-1068f28b5eb0 to /dev/vdb
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG os_brick.utils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[44024aef-edd5-45c2-81da-7386e2b91d47]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44a8e06-0e86-4575-be9a-78c9c9c014c6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d2d16c9-96cc-4aeb-8fa7-ab9c56c02945]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[09bb0a12-afdd-4f2d-b1d4-fc2edc9b40e3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:28:03 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3378a9b-7a4b-4989-ac41-4e1afafe31d0]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG os_brick.utils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] <== get_connector_properties: return (132ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating existing volume attachment record: 1c9724a6-1aa2-41a4-a4ce-614ee8494cbd {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:28:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:04 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:28:04 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7017MB free_disk=25.025409698486328GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b1ffa0dd-1f28-40f1-83e1-4a677302483c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1d2937fc-16d6-4167-9b43-f0f44663deda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a437e642-d3a4-4356-805e-cb68da21167f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4a45616a-3df0-45b0-8271-881c49140a0a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8475b9aa-13f8-4cf4-9636-743bee133121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f64688a-b3db-4879-81f9-0a35923aae42 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ede4b1ad-5bee-498e-8692-08b00dfa323a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8fbbb791-da59-44ba-997c-0b0ff3957539 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:28:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:28:05 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:28:05 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:28:05 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:28:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.119s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:06 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:28:06 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:28:06 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "4a45616a-3df0-45b0-8271-881c49140a0a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "4a45616a-3df0-45b0-8271-881c49140a0a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:08 user nova-compute[75102]: INFO nova.compute.manager [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Terminating instance
Nov 10 16:28:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-9f5afeb3-16f3-43fe-ab2d-eb5aba19f917 req-e050818b-8d66-4419-9124-d55a69d4ccaf service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received event network-vif-unplugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9f5afeb3-16f3-43fe-ab2d-eb5aba19f917 req-e050818b-8d66-4419-9124-d55a69d4ccaf service nova] Acquiring lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9f5afeb3-16f3-43fe-ab2d-eb5aba19f917 req-e050818b-8d66-4419-9124-d55a69d4ccaf service nova] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9f5afeb3-16f3-43fe-ab2d-eb5aba19f917 req-e050818b-8d66-4419-9124-d55a69d4ccaf service nova] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-9f5afeb3-16f3-43fe-ab2d-eb5aba19f917 req-e050818b-8d66-4419-9124-d55a69d4ccaf service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] No waiting events found dispatching network-vif-unplugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-9f5afeb3-16f3-43fe-ab2d-eb5aba19f917 req-e050818b-8d66-4419-9124-d55a69d4ccaf service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received event network-vif-unplugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:28:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Instance destroyed successfully.
Nov 10 16:28:09 user nova-compute[75102]: DEBUG nova.objects.instance [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lazy-loading 'resources' on Instance uuid 4a45616a-3df0-45b0-8271-881c49140a0a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-341555748',display_name='tempest-VolumesAdminNegativeTest-server-341555748',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-341555748',id=22,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:26:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6ce78721e684c9581fba3a8412b6ac5',ramdisk_id='',reservation_id='r-v89bj9f8',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1261870727',owner_user_name='tempest-VolumesAdminNegativeTest-1261870727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:26:13Z,user_data=None,user_id='1471fdc4198b43adbdadb762d584acc6',uuid=4a45616a-3df0-45b0-8271-881c49140a0a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converting VIF {"id": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "address": "fa:16:3e:92:00:4a", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "taped733bdd-15", "ovs_interfaceid": "ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped733bdd-15') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG os_vif [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped733bdd-15') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=taped733bdd-15, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=60811b1d-d007-4e11-b5cd-205b7143ba04) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:09 user nova-compute[75102]: INFO os_vif [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:92:00:4a,bridge_name='br-int',has_traffic_filtering=True,id=ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='taped733bdd-15')
Nov 10 16:28:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Deleting instance files /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a_del
Nov 10 16:28:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Deletion of /opt/stack/data/nova/instances/4a45616a-3df0-45b0-8271-881c49140a0a_del complete
Nov 10 16:28:09 user nova-compute[75102]: INFO nova.compute.manager [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Took 0.92 seconds to destroy the instance on the hypervisor.
Nov 10 16:28:09 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:09 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Took 0.44 seconds to deallocate network for instance.
Nov 10 16:28:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:10 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:28:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:28:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:10 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Deleted allocations for instance 4a45616a-3df0-45b0-8271-881c49140a0a
Nov 10 16:28:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-2169468f-4920-45c5-8c08-83d9e6ef17e2 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "4a45616a-3df0-45b0-8271-881c49140a0a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.995s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-6fefab23-74fb-4cc1-8385-e22d4969cf86 req-1a6c6af9-7e5d-463d-80e0-93d04c6d7ae4 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received event network-vif-plugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6fefab23-74fb-4cc1-8385-e22d4969cf86 req-1a6c6af9-7e5d-463d-80e0-93d04c6d7ae4 service nova] Acquiring lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6fefab23-74fb-4cc1-8385-e22d4969cf86 req-1a6c6af9-7e5d-463d-80e0-93d04c6d7ae4 service nova] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6fefab23-74fb-4cc1-8385-e22d4969cf86 req-1a6c6af9-7e5d-463d-80e0-93d04c6d7ae4 service nova] Lock "4a45616a-3df0-45b0-8271-881c49140a0a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-6fefab23-74fb-4cc1-8385-e22d4969cf86 req-1a6c6af9-7e5d-463d-80e0-93d04c6d7ae4 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] No waiting events found dispatching network-vif-plugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:10 user nova-compute[75102]: WARNING nova.compute.manager [req-6fefab23-74fb-4cc1-8385-e22d4969cf86 req-1a6c6af9-7e5d-463d-80e0-93d04c6d7ae4 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received unexpected event network-vif-plugged-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c for instance with vm_state deleted and task_state None.
Nov 10 16:28:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-6fefab23-74fb-4cc1-8385-e22d4969cf86 req-1a6c6af9-7e5d-463d-80e0-93d04c6d7ae4 service nova] [instance: 4a45616a-3df0-45b0-8271-881c49140a0a] Received event network-vif-deleted-ed733bdd-15ea-4fff-8d0d-b6eb03b5c69c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:16 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b1ffa0dd-1f28-40f1-83e1-4a677302483c is timed out.
Nov 10 16:28:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully detached device vdb from instance b1ffa0dd-1f28-40f1-83e1-4a677302483c from the live domain config.
Nov 10 16:28:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZHDafhiX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:28:16 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a907a7-785e-4428-8ba6-c96e85f8f36e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:28:16 user nova-compute[75102]: No targets found.
Nov 10 16:28:16 user nova-compute[75102]: iSNS:
Nov 10 16:28:16 user nova-compute[75102]: No targets found.
Nov 10 16:28:16 user nova-compute[75102]: STATIC:
Nov 10 16:28:16 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f
Nov 10 16:28:16 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:28:16 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:28:16 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881
Nov 10 16:28:16 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:28:16 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:28:16 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:28:16 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:28:16 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:28:16 user nova-compute[75102]: FIRMWARE:
Nov 10 16:28:16 user nova-compute[75102]: No targets found.
Nov 10 16:28:16 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:28:16 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:28:16 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d5403b2-8130-4474-9c76-164777be1f76]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca041f8-b93a-4c47-9f55-2a29bd90f209]: (4, ('tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:28:16 user nova-compute[75102]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:28:16 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:28:16 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsi session list stdout=tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 (non-flash)
Nov 10 16:28:16 user nova-compute[75102]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:28:16 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:28:16 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f545b2440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[01976dcd-c5eb-49e7-ab1d-ba974fd52f74]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8f54c9-5b5d-446b-b93d-8ba78d187069]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0cb982-b015-4797-9d5a-e1a8ed1991e2]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.033s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[79be532c-58e4-45a3-8440-10d21bd434d9]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c61714a-fdac-45e2-94b1-af6d02e427c1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[377600e9-bb86-4add-a350-4304f9db6f50]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260]
Nov 10 16:28:16 user nova-compute[75102]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881, portal: 172.16.0.220,3260] successful.
Nov 10 16:28:16 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:47a37063-5d3a-443d-a66d-331b3fc1b881 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[599fb0e9-b9a0-45b7-ae0c-53475c362da0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.283s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] <== disconnect_volume: return (284ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:28:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:28:17 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'flavor' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5df3298-ad0d-48a3-b079-bf2d4026b165 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.320s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:28:18 user nova-compute[75102]: INFO nova.compute.claims [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Claim successful on node user
Nov 10 16:28:18 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.516s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:28:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:28:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:28:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:28:18 user nova-compute[75102]: INFO nova.virt.block_device [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Booting with volume-backed-image a26f5e2e-1666-4272-b064-065539894418 at /dev/vda
Nov 10 16:28:18 user nova-compute[75102]: DEBUG nova.policy [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3149d0620bf64829aa4eec99a2cddee5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c0e926f56f914e7488a50f5bb78a33cd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:28:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Successfully created port: 728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Successfully updated port: 728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquired lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-4b250d33-29c3-4611-a2d6-c98a18fe7447 req-3ea042f5-9d77-4ff0-8ae7-91ab76a40ea7 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-changed-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-4b250d33-29c3-4611-a2d6-c98a18fe7447 req-3ea042f5-9d77-4ff0-8ae7-91ab76a40ea7 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Refreshing instance network info cache due to event network-changed-728d5a24-aa97-4f3f-b8b0-3436cdb1d100. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4b250d33-29c3-4611-a2d6-c98a18fe7447 req-3ea042f5-9d77-4ff0-8ae7-91ab76a40ea7 service nova] Acquiring lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG nova.network.neutron [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Updating instance_info_cache with network_info: [{"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Releasing lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Instance network_info: |[{"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4b250d33-29c3-4611-a2d6-c98a18fe7447 req-3ea042f5-9d77-4ff0-8ae7-91ab76a40ea7 service nova] Acquired lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:28:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-4b250d33-29c3-4611-a2d6-c98a18fe7447 req-3ea042f5-9d77-4ff0-8ae7-91ab76a40ea7 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Refreshing network info cache for port 728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:28:22 user nova-compute[75102]: DEBUG nova.network.neutron [req-4b250d33-29c3-4611-a2d6-c98a18fe7447 req-3ea042f5-9d77-4ff0-8ae7-91ab76a40ea7 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Updated VIF entry in instance network info cache for port 728d5a24-aa97-4f3f-b8b0-3436cdb1d100. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:28:22 user nova-compute[75102]: DEBUG nova.network.neutron [req-4b250d33-29c3-4611-a2d6-c98a18fe7447 req-3ea042f5-9d77-4ff0-8ae7-91ab76a40ea7 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Updating instance_info_cache with network_info: [{"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4b250d33-29c3-4611-a2d6-c98a18fe7447 req-3ea042f5-9d77-4ff0-8ae7-91ab76a40ea7 service nova] Releasing lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:28:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQeiCJaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:28:29 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:28:29 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:28:29 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2884ba69-8c01-4195-b34c-d92a4a614e9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:28:29 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecce5a16-efcc-4be0-a8fe-e89f50e21a6d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0] added
Nov 10 16:28:29 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e44289-7a8e-48f8-b228-e6ab08d066e9]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e0fe88-9693-4417-9f0e-af5725a5bf58]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQeiCJaN {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQeiCJaN" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f3e8ce-3709-42de-a02f-c1c23f04b336]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQeiCJaN'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[48f75a83-28af-4794-99c4-8933c4b57c77]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6981ccff-2778-46dc-bbc3-688c672b407f]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:28:29 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:28:29 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:28:29 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:28:29 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a19bec-63c6-4b49-88a5-e97d6f016971]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0, portal: 172.16.0.220,3260]
Nov 10 16:28:29 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0, portal: 172.16.0.220,3260] successful.
Nov 10 16:28:29 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[284ba01a-14c5-4904-9a7a-0e813dd7f0ed]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9322a1d6-f57d-445b-b919-c5ac1bd898f1]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:28:29 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:28:29 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:28:29 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:28:29 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:28:29 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:28:29 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] HCTL ('35', '-', '-', 0) found on session 22 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[25877049-ad9a-4d11-9009-ef324f649c4b]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:29 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:28:30 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Searching for a device in session 22 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:28:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQeiCJaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:28:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:28:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26236333238613132', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:28:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236333238613132', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:28:30 user nova-compute[75102]: DEBUG nova.objects.instance [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'flavor' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:28:30 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:28:30 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:28:30 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:28:30 user nova-compute[75102]:   <serial>856178a7-34e8-488b-9157-1068f28b5eb0</serial>
Nov 10 16:28:30 user nova-compute[75102]: </disk>
Nov 10 16:28:30 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:28:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:28:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:28:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] No VIF found with MAC fa:16:3e:3a:38:ba, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:28:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-771d990c-373b-4ae1-903b-ae1c25436933 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 27.926s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:33 user nova-compute[75102]: INFO nova.compute.manager [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Rescuing
Nov 10 16:28:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquired lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG nova.network.neutron [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG nova.network.neutron [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating instance_info_cache with network_info: [{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Releasing lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-788dbab4-d169-44c7-8b39-b71dc17e2b01 req-99d83a55-6e71-4fdc-bcf0-5605d919282f service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-unplugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-788dbab4-d169-44c7-8b39-b71dc17e2b01 req-99d83a55-6e71-4fdc-bcf0-5605d919282f service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-788dbab4-d169-44c7-8b39-b71dc17e2b01 req-99d83a55-6e71-4fdc-bcf0-5605d919282f service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-788dbab4-d169-44c7-8b39-b71dc17e2b01 req-99d83a55-6e71-4fdc-bcf0-5605d919282f service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-788dbab4-d169-44c7-8b39-b71dc17e2b01 req-99d83a55-6e71-4fdc-bcf0-5605d919282f service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-unplugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:33 user nova-compute[75102]: WARNING nova.compute.manager [req-788dbab4-d169-44c7-8b39-b71dc17e2b01 req-99d83a55-6e71-4fdc-bcf0-5605d919282f service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-unplugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state active and task_state rescuing.
Nov 10 16:28:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Instance destroyed successfully.
Nov 10 16:28:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Attempting a stable device rescue
Nov 10 16:28:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75102) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 16:28:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Instance directory exists: not creating {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 16:28:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Creating image(s)
Nov 10 16:28:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:34 user nova-compute[75102]: DEBUG nova.objects.instance [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'trusted_certs' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "2bca8097731af33d51c4ce15c257ef8dadbfb6f2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "2bca8097731af33d51c4ce15c257ef8dadbfb6f2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2.part --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2.part --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG nova.virt.images [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] 153eef46-345e-4738-b2a7-eb13e22b1bed was qcow2, converting to raw {{(pid=75102) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2.part /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2.converted {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-2e2ba423-2614-4a7f-99d1-2027cc418872 req-88f8d514-4a61-4862-8800-3565e8d8a93d service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2e2ba423-2614-4a7f-99d1-2027cc418872 req-88f8d514-4a61-4862-8800-3565e8d8a93d service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2e2ba423-2614-4a7f-99d1-2027cc418872 req-88f8d514-4a61-4862-8800-3565e8d8a93d service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2e2ba423-2614-4a7f-99d1-2027cc418872 req-88f8d514-4a61-4862-8800-3565e8d8a93d service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-2e2ba423-2614-4a7f-99d1-2027cc418872 req-88f8d514-4a61-4862-8800-3565e8d8a93d service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:35 user nova-compute[75102]: WARNING nova.compute.manager [req-2e2ba423-2614-4a7f-99d1-2027cc418872 req-88f8d514-4a61-4862-8800-3565e8d8a93d service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state active and task_state rescuing.
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2.part /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2.converted" returned: 0 in 0.476s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2.converted --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2.converted --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "2bca8097731af33d51c4ce15c257ef8dadbfb6f2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.900s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "2bca8097731af33d51c4ce15c257ef8dadbfb6f2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "2bca8097731af33d51c4ce15c257ef8dadbfb6f2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2 --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2,backing_fmt=raw /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2,backing_fmt=raw /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue" returned: 0 in 0.055s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "2bca8097731af33d51c4ce15c257ef8dadbfb6f2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.objects.instance [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'migration_context' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.objects.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Object Instance<1d2937fc-16d6-4167-9b43-f0f44663deda> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Start _get_guest_xml network_info=[{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "vif_mac": "fa:16:3e:3a:38:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '153eef46-345e-4738-b2a7-eb13e22b1bed', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '1c9724a6-1aa2-41a4-a4ce-614ee8494cbd', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQeiCJaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': '1d2937fc-16d6-4167-9b43-f0f44663deda', 'attached_at': '', 'detached_at': '', 'volume_id': '856178a7-34e8-488b-9157-1068f28b5eb0', 'serial': '856178a7-34e8-488b-9157-1068f28b5eb0'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.objects.instance [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'resources' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.objects.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Object Instance<1d2937fc-16d6-4167-9b43-f0f44663deda> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.objects.instance [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'numa_topology' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.objects.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Object Instance<1d2937fc-16d6-4167-9b43-f0f44663deda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:28:36 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:28:36 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.objects.instance [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'vcpu_model' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.objects.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Object Instance<1d2937fc-16d6-4167-9b43-f0f44663deda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQeiCJaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:28:36 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:28:36 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:28:36 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d7b1fc-5d8b-4530-889d-db7ee1d34934]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = YQeiCJaN\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 16:28:36 user nova-compute[75102]: node.name = iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0
Nov 10 16:28:36 user nova-compute[75102]: node.tpgt = -1
Nov 10 16:28:36 user nova-compute[75102]: node.startup = automatic
Nov 10 16:28:36 user nova-compute[75102]: node.leading_login = No
Nov 10 16:28:36 user nova-compute[75102]: iface.iscsi_ifacename = default
Nov 10 16:28:36 user nova-compute[75102]: iface.net_ifacename = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.ipaddress = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.prefix_len = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.hwaddress = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.transport_name = tcp
Nov 10 16:28:36 user nova-compute[75102]: iface.initiatorname = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.state = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.vlan_id = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.vlan_priority = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.vlan_state = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.iface_num = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.mtu = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.port = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.bootproto = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.subnet_mask = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.gateway = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.dhcp_alt_client_id = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.dhcp_dns = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.dhcp_learn_iqn = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.dhcp_vendor_id_state = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.dhcp_vendor_id = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.dhcp_slp_da = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.fragmentation = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.gratuitous_arp = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.incoming_forwarding = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.tos_state = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.tos = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.ttl = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.delayed_ack = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.tcp_nagle = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.tcp_wsf_state = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.tcp_wsf = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.tcp_timer_scale = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.tcp_timestamp = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.redirect = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.def_task_mgmt_timeout = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.header_digest = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.data_digest = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.immediate_data = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.initial_r2t = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.data_seq_inorder = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.data_pdu_inorder = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.erl = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.max_receive_data_len = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.first_burst_len = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.max_outstanding_r2t = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.max_burst_len = 0
Nov 10 16:28:36 user nova-compute[75102]: iface.chap_auth = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.bidi_chap = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.strict_login_compliance = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.discovery_auth = <empty>
Nov 10 16:28:36 user nova-compute[75102]: iface.discovery_logout = <empty>
Nov 10 16:28:36 user nova-compute[75102]: node.discovery_address = <empty>
Nov 10 16:28:36 user nova-compute[75102]: node.discovery_port = 0
Nov 10 16:28:36 user nova-compute[75102]: node.discovery_type = static
Nov 10 16:28:36 user nova-compute[75102]: node.session.initial_cmdsn = 0
Nov 10 16:28:36 user nova-compute[75102]: node.session.initial_login_retry_max = 8
Nov 10 16:28:36 user nova-compute[75102]: node.session.xmit_thread_priority = -20
Nov 10 16:28:36 user nova-compute[75102]: node.session.cmds_max = 128
Nov 10 16:28:36 user nova-compute[75102]: node.session.queue_depth = 32
Nov 10 16:28:36 user nova-compute[75102]: node.session.nr_sessions = 1
Nov 10 16:28:36 user nova-compute[75102]: node.session.auth.authmethod = CHAP
Nov 10 16:28:36 user nova-compute[75102]: node.session.auth.username = YQeiCJaN
Nov 10 16:28:36 user nova-compute[75102]: node.session.auth.password = ***
Nov 10 16:28:36 user nova-compute[75102]: node.session.auth.username_in = <empty>
Nov 10 16:28:36 user nova-compute[75102]: node.session.auth.password_in = <empty>
Nov 10 16:28:36 user nova-compute[75102]: node.session.auth.chap_algs = MD5
Nov 10 16:28:36 user nova-compute[75102]: node.session.timeo.replacement_timeout = 120
Nov 10 16:28:36 user nova-compute[75102]: node.session.err_timeo.abort_timeout = 15
Nov 10 16:28:36 user nova-compute[75102]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 16:28:36 user nova-compute[75102]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 16:28:36 user nova-compute[75102]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.FastAbort = Yes
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.InitialR2T = No
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.ImmediateData = Yes
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.MaxConnections = 1
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 16:28:36 user nova-compute[75102]: node.session.iscsi.ERL = 0
Nov 10 16:28:36 user nova-compute[75102]: node.session.scan = manual
Nov 10 16:28:36 user nova-compute[75102]: node.session.reopen_max = 0
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].address = 172.16.0.220
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].port = 3260
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].startup = manual
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].tcp.window_size = 524288
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].tcp.type_of_service = 0
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].timeo.logout_timeout = 15
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].timeo.login_timeout = 15
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].timeo.auth_timeout = 45
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].iscsi.DataDigest = None
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].iscsi.IFMarker = No
Nov 10 16:28:36 user nova-compute[75102]: node.conn[0].iscsi.OFMarker = No
Nov 10 16:28:36 user nova-compute[75102]: # END RECORD
Nov 10 16:28:36 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e583e12-ba2f-4cc2-8818-ded46448b316]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1517ec-12cd-4ca2-9f41-a04407b582c5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQeiCJaN {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YQeiCJaN" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b543f3d-53ab-4206-9d94-dca09adc8546]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YQeiCJaN'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d24098-5cb9-40d7-bcd3-b8e91c968a69]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ceddd6-17bc-4450-a531-4c7ca37c410c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:28:36 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:28:36 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:28:36 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:28:36 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:28:36 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:28:36 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.147s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] HCTL ('35', '0', '0', 0) found on session 22 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f07317-6fba-4d3d-abe8-9f3098cb7c84]: (4, ('0 0 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Searching for a device in session 22 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQeiCJaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.170s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] <== connect_volume: return (170ms) {'type': 'block', 'scsi_wwn': '26236333238613132', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:28:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236333238613132', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-99936376',display_name='tempest-ServerStableDeviceRescueTest-server-99936376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-99936376',id=17,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3swAiY8IXi0LnDIDxdU5FjDWvfkVZ1YU60EUEocwoFUqORwq5Ulkba+xhxutRCA/obuR4eZ0OFPXP2AvkMlrjPBU9bb7EzeBuLnkEcOhPrf7ZVeVhNdp6h6lDwURsHtg==',key_name='tempest-keypair-1511821701',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:24:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938b3e81d96f48d5977b4e676260a5a5',ramdisk_id='',reservation_id='r-o2v2dsqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1704477030',owner_user_name='tempest-ServerStableDeviceRescueTest-1704477030-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:26:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2125de3b2d6404c8391d3dce984dc67',uuid=1d2937fc-16d6-4167-9b43-f0f44663deda,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "vif_mac": "fa:16:3e:3a:38:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Converting VIF {"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "vif_mac": "fa:16:3e:3a:38:ba"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:38:ba,bridge_name='br-int',has_traffic_filtering=True,id=717a43fb-d615-4290-806b-cfaa817bee6f,network=Network(d2738093-d847-44d1-9d52-92240b21aa1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717a43fb-d6') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.objects.instance [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'pci_devices' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.objects.base [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Object Instance<1d2937fc-16d6-4167-9b43-f0f44663deda> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:28:37 user nova-compute[75102]:   <uuid>1d2937fc-16d6-4167-9b43-f0f44663deda</uuid>
Nov 10 16:28:37 user nova-compute[75102]:   <name>instance-00000011</name>
Nov 10 16:28:37 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:28:37 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:28:37 user nova-compute[75102]:   <metadata>
Nov 10 16:28:37 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:28:37 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:28:37 user nova-compute[75102]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-99936376</nova:name>
Nov 10 16:28:37 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:28:36</nova:creationTime>
Nov 10 16:28:37 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:28:37 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:28:37 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:28:37 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:28:37 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:28:37 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:28:37 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:28:37 user nova-compute[75102]:       <nova:owner>
Nov 10 16:28:37 user nova-compute[75102]:         <nova:user uuid="c2125de3b2d6404c8391d3dce984dc67">tempest-ServerStableDeviceRescueTest-1704477030-project-member</nova:user>
Nov 10 16:28:37 user nova-compute[75102]:         <nova:project uuid="938b3e81d96f48d5977b4e676260a5a5">tempest-ServerStableDeviceRescueTest-1704477030</nova:project>
Nov 10 16:28:37 user nova-compute[75102]:       </nova:owner>
Nov 10 16:28:37 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:28:37 user nova-compute[75102]:       <nova:ports>
Nov 10 16:28:37 user nova-compute[75102]:         <nova:port uuid="717a43fb-d615-4290-806b-cfaa817bee6f">
Nov 10 16:28:37 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 16:28:37 user nova-compute[75102]:         </nova:port>
Nov 10 16:28:37 user nova-compute[75102]:       </nova:ports>
Nov 10 16:28:37 user nova-compute[75102]:     </nova:instance>
Nov 10 16:28:37 user nova-compute[75102]:   </metadata>
Nov 10 16:28:37 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:28:37 user nova-compute[75102]:     <system>
Nov 10 16:28:37 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:28:37 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:28:37 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:28:37 user nova-compute[75102]:       <entry name="serial">1d2937fc-16d6-4167-9b43-f0f44663deda</entry>
Nov 10 16:28:37 user nova-compute[75102]:       <entry name="uuid">1d2937fc-16d6-4167-9b43-f0f44663deda</entry>
Nov 10 16:28:37 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:28:37 user nova-compute[75102]:     </system>
Nov 10 16:28:37 user nova-compute[75102]:   </sysinfo>
Nov 10 16:28:37 user nova-compute[75102]:   <os>
Nov 10 16:28:37 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:28:37 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:28:37 user nova-compute[75102]:   </os>
Nov 10 16:28:37 user nova-compute[75102]:   <features>
Nov 10 16:28:37 user nova-compute[75102]:     <acpi/>
Nov 10 16:28:37 user nova-compute[75102]:     <apic/>
Nov 10 16:28:37 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:28:37 user nova-compute[75102]:   </features>
Nov 10 16:28:37 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:28:37 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:28:37 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:28:37 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:28:37 user nova-compute[75102]:   </clock>
Nov 10 16:28:37 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:28:37 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:28:37 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:28:37 user nova-compute[75102]:   </cpu>
Nov 10 16:28:37 user nova-compute[75102]:   <devices>
Nov 10 16:28:37 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:28:37 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:28:37 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk"/>
Nov 10 16:28:37 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:28:37 user nova-compute[75102]:     </disk>
Nov 10 16:28:37 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:28:37 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:28:37 user nova-compute[75102]:       <source dev="/dev/sdd"/>
Nov 10 16:28:37 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:28:37 user nova-compute[75102]:       <serial>856178a7-34e8-488b-9157-1068f28b5eb0</serial>
Nov 10 16:28:37 user nova-compute[75102]:     </disk>
Nov 10 16:28:37 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:28:37 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:28:37 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue"/>
Nov 10 16:28:37 user nova-compute[75102]:       <target dev="vdc" bus="virtio"/>
Nov 10 16:28:37 user nova-compute[75102]:       <boot order="1"/>
Nov 10 16:28:37 user nova-compute[75102]:     </disk>
Nov 10 16:28:37 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:28:37 user nova-compute[75102]:       <mac address="fa:16:3e:3a:38:ba"/>
Nov 10 16:28:37 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:28:37 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:28:37 user nova-compute[75102]:       <target dev="tap717a43fb-d6"/>
Nov 10 16:28:37 user nova-compute[75102]:     </interface>
Nov 10 16:28:37 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:28:37 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/console.log" append="off"/>
Nov 10 16:28:37 user nova-compute[75102]:     </serial>
Nov 10 16:28:37 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:28:37 user nova-compute[75102]:     <video>
Nov 10 16:28:37 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:28:37 user nova-compute[75102]:     </video>
Nov 10 16:28:37 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:28:37 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:28:37 user nova-compute[75102]:     </rng>
Nov 10 16:28:37 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:28:37 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:28:37 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:28:37 user nova-compute[75102]:     </memballoon>
Nov 10 16:28:37 user nova-compute[75102]:   </devices>
Nov 10 16:28:37 user nova-compute[75102]: </domain>
Nov 10 16:28:37 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:28:37 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Instance destroyed successfully.
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:28:37 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] No VIF found with MAC fa:16:3e:3a:38:ba, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:28:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-57d8bc17-449d-4ebe-958b-f622e3422910 req-fad162e0-f3fa-4549-8df5-1ed62c7b610d service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-57d8bc17-449d-4ebe-958b-f622e3422910 req-fad162e0-f3fa-4549-8df5-1ed62c7b610d service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-57d8bc17-449d-4ebe-958b-f622e3422910 req-fad162e0-f3fa-4549-8df5-1ed62c7b610d service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-57d8bc17-449d-4ebe-958b-f622e3422910 req-fad162e0-f3fa-4549-8df5-1ed62c7b610d service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-57d8bc17-449d-4ebe-958b-f622e3422910 req-fad162e0-f3fa-4549-8df5-1ed62c7b610d service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:38 user nova-compute[75102]: WARNING nova.compute.manager [req-57d8bc17-449d-4ebe-958b-f622e3422910 req-fad162e0-f3fa-4549-8df5-1ed62c7b610d service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state active and task_state rescuing.
Nov 10 16:28:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG os_brick.utils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c1cc47-fe32-46f4-b6a9-059b45709d38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[11744393-6799-4cc6-8f50-d365f7c8388d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[41bd620c-7f42-4605-9f31-a7164800f9f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[aadfe685-d45d-466a-aaf7-f3831de8f8d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:28:40 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:28:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2edd366-ab55-49a9-b4ca-c6e7a5847e67]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG os_brick.utils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Updating existing volume attachment record: 7bb91a95-b74a-46d3-9f9f-a2958b36d3e2 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG nova.compute.manager [req-143734fc-03ed-4a79-8e15-e5d6240b3740 req-499fe9c3-521a-4a74-baf2-9faa4abd4347 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-143734fc-03ed-4a79-8e15-e5d6240b3740 req-499fe9c3-521a-4a74-baf2-9faa4abd4347 service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-143734fc-03ed-4a79-8e15-e5d6240b3740 req-499fe9c3-521a-4a74-baf2-9faa4abd4347 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-143734fc-03ed-4a79-8e15-e5d6240b3740 req-499fe9c3-521a-4a74-baf2-9faa4abd4347 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:40 user nova-compute[75102]: DEBUG nova.compute.manager [req-143734fc-03ed-4a79-8e15-e5d6240b3740 req-499fe9c3-521a-4a74-baf2-9faa4abd4347 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:40 user nova-compute[75102]: WARNING nova.compute.manager [req-143734fc-03ed-4a79-8e15-e5d6240b3740 req-499fe9c3-521a-4a74-baf2-9faa4abd4347 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state active and task_state rescuing.
Nov 10 16:28:40 user nova-compute[75102]: DEBUG nova.compute.manager [None req-32857417-fe05-459e-996b-39fb0b7c0a4f tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:28:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-f56dca08-bbd1-4ed9-b8b8-8b0fa21f30b0 req-f8bbaa0b-b574-4ba6-9053-5bb3cda2374c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received event network-changed-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-f56dca08-bbd1-4ed9-b8b8-8b0fa21f30b0 req-f8bbaa0b-b574-4ba6-9053-5bb3cda2374c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Refreshing instance network info cache due to event network-changed-68b9de94-fc76-474f-9d06-cd6552434dec. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:28:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f56dca08-bbd1-4ed9-b8b8-8b0fa21f30b0 req-f8bbaa0b-b574-4ba6-9053-5bb3cda2374c service nova] Acquiring lock "refresh_cache-8475b9aa-13f8-4cf4-9636-743bee133121" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:28:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f56dca08-bbd1-4ed9-b8b8-8b0fa21f30b0 req-f8bbaa0b-b574-4ba6-9053-5bb3cda2374c service nova] Acquired lock "refresh_cache-8475b9aa-13f8-4cf4-9636-743bee133121" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:28:43 user nova-compute[75102]: DEBUG nova.network.neutron [req-f56dca08-bbd1-4ed9-b8b8-8b0fa21f30b0 req-f8bbaa0b-b574-4ba6-9053-5bb3cda2374c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Refreshing network info cache for port 68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:28:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-f56dca08-bbd1-4ed9-b8b8-8b0fa21f30b0 req-f8bbaa0b-b574-4ba6-9053-5bb3cda2374c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Updated VIF entry in instance network info cache for port 68b9de94-fc76-474f-9d06-cd6552434dec. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:28:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-f56dca08-bbd1-4ed9-b8b8-8b0fa21f30b0 req-f8bbaa0b-b574-4ba6-9053-5bb3cda2374c service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Updating instance_info_cache with network_info: [{"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f56dca08-bbd1-4ed9-b8b8-8b0fa21f30b0 req-f8bbaa0b-b574-4ba6-9053-5bb3cda2374c service nova] Releasing lock "refresh_cache-8475b9aa-13f8-4cf4-9636-743bee133121" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:28:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquiring lock "3f64688a-b3db-4879-81f9-0a35923aae42" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "3f64688a-b3db-4879-81f9-0a35923aae42" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquiring lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:50 user nova-compute[75102]: INFO nova.compute.manager [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Terminating instance
Nov 10 16:28:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:28:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-c216a593-e0e2-4000-bdda-9b1ecf5914ba req-45abc9a6-c0d4-4760-b04d-ae2e8e4d417b service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received event network-vif-unplugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c216a593-e0e2-4000-bdda-9b1ecf5914ba req-45abc9a6-c0d4-4760-b04d-ae2e8e4d417b service nova] Acquiring lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c216a593-e0e2-4000-bdda-9b1ecf5914ba req-45abc9a6-c0d4-4760-b04d-ae2e8e4d417b service nova] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c216a593-e0e2-4000-bdda-9b1ecf5914ba req-45abc9a6-c0d4-4760-b04d-ae2e8e4d417b service nova] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-c216a593-e0e2-4000-bdda-9b1ecf5914ba req-45abc9a6-c0d4-4760-b04d-ae2e8e4d417b service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] No waiting events found dispatching network-vif-unplugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-c216a593-e0e2-4000-bdda-9b1ecf5914ba req-45abc9a6-c0d4-4760-b04d-ae2e8e4d417b service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received event network-vif-unplugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:28:51 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Instance destroyed successfully.
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.objects.instance [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lazy-loading 'resources' on Instance uuid 3f64688a-b3db-4879-81f9-0a35923aae42 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:27:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-329465846',display_name='tempest-VolumesNegativeTest-instance-329465846',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-329465846',id=24,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:27:09Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='584ee1f0e06a4b0e99a0dba965541b18',ramdisk_id='',reservation_id='r-tagvtw6p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-777079920',owner_user_name='tempest-VolumesNegativeTest-777079920-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:27:09Z,user_data=None,user_id='ca09662ed2434005b610a4b2366c3a96',uuid=3f64688a-b3db-4879-81f9-0a35923aae42,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "address": "fa:16:3e:f5:5c:67", "network": {"id": "06ba9c71-267c-4c62-9154-c6835b7b274a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "27ab322133744b01aba75af5d356371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75115f2e-23", "ovs_interfaceid": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Converting VIF {"id": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "address": "fa:16:3e:f5:5c:67", "network": {"id": "06ba9c71-267c-4c62-9154-c6835b7b274a", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.144", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "27ab322133744b01aba75af5d356371f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75115f2e-23", "ovs_interfaceid": "75115f2e-2399-4cc5-8a58-84ea4e3501e1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:67,bridge_name='br-int',has_traffic_filtering=True,id=75115f2e-2399-4cc5-8a58-84ea4e3501e1,network=Network(06ba9c71-267c-4c62-9154-c6835b7b274a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75115f2e-23') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG os_vif [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:67,bridge_name='br-int',has_traffic_filtering=True,id=75115f2e-2399-4cc5-8a58-84ea4e3501e1,network=Network(06ba9c71-267c-4c62-9154-c6835b7b274a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75115f2e-23') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75115f2e-23, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e02cab1-0bcf-4ccf-b0c6-d8a9f2e51bd3) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:51 user nova-compute[75102]: INFO os_vif [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f5:5c:67,bridge_name='br-int',has_traffic_filtering=True,id=75115f2e-2399-4cc5-8a58-84ea4e3501e1,network=Network(06ba9c71-267c-4c62-9154-c6835b7b274a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75115f2e-23')
Nov 10 16:28:51 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Deleting instance files /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42_del
Nov 10 16:28:51 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Deletion of /opt/stack/data/nova/instances/3f64688a-b3db-4879-81f9-0a35923aae42_del complete
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:28:51 user nova-compute[75102]: INFO nova.compute.manager [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:28:51 user nova-compute[75102]: INFO nova.compute.claims [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Claim successful on node user
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG nova.objects.instance [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'flavor' on Instance uuid 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.117s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:52 user nova-compute[75102]: INFO nova.compute.manager [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Attaching volume 382719ab-3240-420a-bde6-49e68ac50241 to /dev/vdb
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-61971f95-a3af-422b-ba70-c1e85282663e req-dba59b4c-674c-485d-a4b0-d1986f641ed7 service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received event network-vif-deleted-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:52 user nova-compute[75102]: INFO nova.compute.manager [req-61971f95-a3af-422b-ba70-c1e85282663e req-dba59b4c-674c-485d-a4b0-d1986f641ed7 service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Neutron deleted interface 75115f2e-2399-4cc5-8a58-84ea4e3501e1; detaching it from the instance and deleting it from the info cache
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.network.neutron [req-61971f95-a3af-422b-ba70-c1e85282663e req-dba59b4c-674c-485d-a4b0-d1986f641ed7 service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:52 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Took 0.55 seconds to deallocate network for instance.
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-61971f95-a3af-422b-ba70-c1e85282663e req-dba59b4c-674c-485d-a4b0-d1986f641ed7 service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Detach interface failed, port_id=75115f2e-2399-4cc5-8a58-84ea4e3501e1, reason: Instance 3f64688a-b3db-4879-81f9-0a35923aae42 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG os_brick.utils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[111d0343-16e1-4b5b-8112-cd7862924d1f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5389d0-6a86-4780-8351-bded9d358b2e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eafb1e3d-3086-4ce7-9030-8c5df808bd12]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1613bf-5af9-4f52-986d-b180e2e538ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:28:52 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[467bbe8d-dabc-44c0-abe3-15b3f88d0058]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG os_brick.utils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] <== get_connector_properties: return (188ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Updating existing volume attachment record: ef429744-e1a1-4f37-b117-561bb00cb9ff {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.965s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.422s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.network.neutron [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:28:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.policy [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bbea9eecf0b4e998ad458bc0d30a5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5704b433744dd8188e61d576dd461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:28:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Creating image(s)
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.250s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG nova.compute.manager [req-0e77b360-8845-4e89-868c-ee86761704d3 req-63af1ae9-ae34-498b-869d-0ffc8049633e service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received event network-vif-plugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0e77b360-8845-4e89-868c-ee86761704d3 req-63af1ae9-ae34-498b-869d-0ffc8049633e service nova] Acquiring lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0e77b360-8845-4e89-868c-ee86761704d3 req-63af1ae9-ae34-498b-869d-0ffc8049633e service nova] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0e77b360-8845-4e89-868c-ee86761704d3 req-63af1ae9-ae34-498b-869d-0ffc8049633e service nova] Lock "3f64688a-b3db-4879-81f9-0a35923aae42-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG nova.compute.manager [req-0e77b360-8845-4e89-868c-ee86761704d3 req-63af1ae9-ae34-498b-869d-0ffc8049633e service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] No waiting events found dispatching network-vif-plugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:53 user nova-compute[75102]: WARNING nova.compute.manager [req-0e77b360-8845-4e89-868c-ee86761704d3 req-63af1ae9-ae34-498b-869d-0ffc8049633e service nova] [instance: 3f64688a-b3db-4879-81f9-0a35923aae42] Received unexpected event network-vif-plugged-75115f2e-2399-4cc5-8a58-84ea4e3501e1 for instance with vm_state deleted and task_state None.
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.683s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:53 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Deleted allocations for instance 3f64688a-b3db-4879-81f9-0a35923aae42
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.251s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk 1073741824" returned: 0 in 0.074s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.332s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG nova.network.neutron [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Successfully created port: 463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-79b13c4c-fd2a-4a3f-862d-bdd04204eb34 tempest-VolumesNegativeTest-777079920 tempest-VolumesNegativeTest-777079920-project-member] Lock "3f64688a-b3db-4879-81f9-0a35923aae42" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.835s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.258s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:28:53 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Cannot resize image /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Ensure instance console log exists: /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Successfully updated port: 463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "refresh_cache-22865b86-3ce3-4ec7-89c4-fc08684a0a60" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquired lock "refresh_cache-22865b86-3ce3-4ec7-89c4-fc08684a0a60" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-6f1d8da1-15d8-4933-8ce9-e1a5c5c67bf9 req-42da63f5-0d19-4018-8af9-e694168aee09 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-changed-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-6f1d8da1-15d8-4933-8ce9-e1a5c5c67bf9 req-42da63f5-0d19-4018-8af9-e694168aee09 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Refreshing instance network info cache due to event network-changed-463f7077-f0c7-4f09-b53b-6d374ec16fa2. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6f1d8da1-15d8-4933-8ce9-e1a5c5c67bf9 req-42da63f5-0d19-4018-8af9-e694168aee09 service nova] Acquiring lock "refresh_cache-22865b86-3ce3-4ec7-89c4-fc08684a0a60" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:28:54 user nova-compute[75102]: DEBUG nova.network.neutron [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.network.neutron [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Updating instance_info_cache with network_info: [{"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Releasing lock "refresh_cache-22865b86-3ce3-4ec7-89c4-fc08684a0a60" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Instance network_info: |[{"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6f1d8da1-15d8-4933-8ce9-e1a5c5c67bf9 req-42da63f5-0d19-4018-8af9-e694168aee09 service nova] Acquired lock "refresh_cache-22865b86-3ce3-4ec7-89c4-fc08684a0a60" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-6f1d8da1-15d8-4933-8ce9-e1a5c5c67bf9 req-42da63f5-0d19-4018-8af9-e694168aee09 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Refreshing network info cache for port 463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Start _get_guest_xml network_info=[{"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:28:55 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:28:55 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1369602086',display_name='tempest-tempest.common.compute-instance-1369602086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1369602086',id=28,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS9aEsC9DkyiXkRLS5dGIYoAHUIm63zekg0VMpktGwjiXXfqBh0WaQ64TY7S97+mYuRLBNgDzeBuXpCBuN7hevXuih4l498smbzR6XPH3ZHHk/XQcFpZYMuQ6Hr0yiLvg==',key_name='tempest-keypair-439595601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-y3on4ld3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:28:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=22865b86-3ce3-4ec7-89c4-fc08684a0a60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.objects.instance [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'pci_devices' on Instance uuid 22865b86-3ce3-4ec7-89c4-fc08684a0a60 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:28:55 user nova-compute[75102]:   <uuid>22865b86-3ce3-4ec7-89c4-fc08684a0a60</uuid>
Nov 10 16:28:55 user nova-compute[75102]:   <name>instance-0000001c</name>
Nov 10 16:28:55 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:28:55 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:28:55 user nova-compute[75102]:   <metadata>
Nov 10 16:28:55 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:28:55 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:28:55 user nova-compute[75102]:       <nova:name>tempest-tempest.common.compute-instance-1369602086</nova:name>
Nov 10 16:28:55 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:28:55</nova:creationTime>
Nov 10 16:28:55 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:28:55 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:28:55 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:28:55 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:28:55 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:28:55 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:28:55 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:28:55 user nova-compute[75102]:       <nova:owner>
Nov 10 16:28:55 user nova-compute[75102]:         <nova:user uuid="7bbea9eecf0b4e998ad458bc0d30a5bf">tempest-ServerActionsTestOtherA-1931720116-project-member</nova:user>
Nov 10 16:28:55 user nova-compute[75102]:         <nova:project uuid="46f5704b433744dd8188e61d576dd461">tempest-ServerActionsTestOtherA-1931720116</nova:project>
Nov 10 16:28:55 user nova-compute[75102]:       </nova:owner>
Nov 10 16:28:55 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:28:55 user nova-compute[75102]:       <nova:ports>
Nov 10 16:28:55 user nova-compute[75102]:         <nova:port uuid="463f7077-f0c7-4f09-b53b-6d374ec16fa2">
Nov 10 16:28:55 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 16:28:55 user nova-compute[75102]:         </nova:port>
Nov 10 16:28:55 user nova-compute[75102]:       </nova:ports>
Nov 10 16:28:55 user nova-compute[75102]:     </nova:instance>
Nov 10 16:28:55 user nova-compute[75102]:   </metadata>
Nov 10 16:28:55 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:28:55 user nova-compute[75102]:     <system>
Nov 10 16:28:55 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:28:55 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:28:55 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:28:55 user nova-compute[75102]:       <entry name="serial">22865b86-3ce3-4ec7-89c4-fc08684a0a60</entry>
Nov 10 16:28:55 user nova-compute[75102]:       <entry name="uuid">22865b86-3ce3-4ec7-89c4-fc08684a0a60</entry>
Nov 10 16:28:55 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:28:55 user nova-compute[75102]:     </system>
Nov 10 16:28:55 user nova-compute[75102]:   </sysinfo>
Nov 10 16:28:55 user nova-compute[75102]:   <os>
Nov 10 16:28:55 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:28:55 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:28:55 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:28:55 user nova-compute[75102]:   </os>
Nov 10 16:28:55 user nova-compute[75102]:   <features>
Nov 10 16:28:55 user nova-compute[75102]:     <acpi/>
Nov 10 16:28:55 user nova-compute[75102]:     <apic/>
Nov 10 16:28:55 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:28:55 user nova-compute[75102]:   </features>
Nov 10 16:28:55 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:28:55 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:28:55 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:28:55 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:28:55 user nova-compute[75102]:   </clock>
Nov 10 16:28:55 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:28:55 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:28:55 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:28:55 user nova-compute[75102]:   </cpu>
Nov 10 16:28:55 user nova-compute[75102]:   <devices>
Nov 10 16:28:55 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:28:55 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:28:55 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk"/>
Nov 10 16:28:55 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:28:55 user nova-compute[75102]:     </disk>
Nov 10 16:28:55 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:28:55 user nova-compute[75102]:       <mac address="fa:16:3e:d0:a8:da"/>
Nov 10 16:28:55 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:28:55 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:28:55 user nova-compute[75102]:       <target dev="tap463f7077-f0"/>
Nov 10 16:28:55 user nova-compute[75102]:     </interface>
Nov 10 16:28:55 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:28:55 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/console.log" append="off"/>
Nov 10 16:28:55 user nova-compute[75102]:     </serial>
Nov 10 16:28:55 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:28:55 user nova-compute[75102]:     <video>
Nov 10 16:28:55 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:28:55 user nova-compute[75102]:     </video>
Nov 10 16:28:55 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:28:55 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:28:55 user nova-compute[75102]:     </rng>
Nov 10 16:28:55 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:28:55 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:28:55 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:28:55 user nova-compute[75102]:     </memballoon>
Nov 10 16:28:55 user nova-compute[75102]:   </devices>
Nov 10 16:28:55 user nova-compute[75102]: </domain>
Nov 10 16:28:55 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1369602086',display_name='tempest-tempest.common.compute-instance-1369602086',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1369602086',id=28,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS9aEsC9DkyiXkRLS5dGIYoAHUIm63zekg0VMpktGwjiXXfqBh0WaQ64TY7S97+mYuRLBNgDzeBuXpCBuN7hevXuih4l498smbzR6XPH3ZHHk/XQcFpZYMuQ6Hr0yiLvg==',key_name='tempest-keypair-439595601',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-y3on4ld3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:28:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=22865b86-3ce3-4ec7-89c4-fc08684a0a60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG os_vif [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c38ddf09-391f-52fe-97d9-3cf85d72b8de', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap463f7077-f0, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap463f7077-f0, col_values=(('qos', UUID('9e9a502c-b5f3-4fad-b7fb-c4aefc37c5a9')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap463f7077-f0, col_values=(('external_ids', {'iface-id': '463f7077-f0c7-4f09-b53b-6d374ec16fa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:a8:da', 'vm-uuid': '22865b86-3ce3-4ec7-89c4-fc08684a0a60'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:55 user nova-compute[75102]: INFO os_vif [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0')
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No VIF found with MAC fa:16:3e:d0:a8:da, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-6f1d8da1-15d8-4933-8ce9-e1a5c5c67bf9 req-42da63f5-0d19-4018-8af9-e694168aee09 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Updated VIF entry in instance network info cache for port 463f7077-f0c7-4f09-b53b-6d374ec16fa2. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG nova.network.neutron [req-6f1d8da1-15d8-4933-8ce9-e1a5c5c67bf9 req-42da63f5-0d19-4018-8af9-e694168aee09 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Updating instance_info_cache with network_info: [{"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6f1d8da1-15d8-4933-8ce9-e1a5c5c67bf9 req-42da63f5-0d19-4018-8af9-e694168aee09 service nova] Releasing lock "refresh_cache-22865b86-3ce3-4ec7-89c4-fc08684a0a60" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:28:56 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:28:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-ccc2de63-1a29-402b-a2d4-9c3f2b10b504 req-63170096-8fcc-42e6-9e3f-2d0582a86f00 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ccc2de63-1a29-402b-a2d4-9c3f2b10b504 req-63170096-8fcc-42e6-9e3f-2d0582a86f00 service nova] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ccc2de63-1a29-402b-a2d4-9c3f2b10b504 req-63170096-8fcc-42e6-9e3f-2d0582a86f00 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ccc2de63-1a29-402b-a2d4-9c3f2b10b504 req-63170096-8fcc-42e6-9e3f-2d0582a86f00 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-ccc2de63-1a29-402b-a2d4-9c3f2b10b504 req-63170096-8fcc-42e6-9e3f-2d0582a86f00 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] No waiting events found dispatching network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:57 user nova-compute[75102]: WARNING nova.compute.manager [req-ccc2de63-1a29-402b-a2d4-9c3f2b10b504 req-63170096-8fcc-42e6-9e3f-2d0582a86f00 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received unexpected event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 for instance with vm_state building and task_state spawning.
Nov 10 16:28:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Skipping network cache update for instance because it is Building. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Skipping network cache update for instance because it is Building. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:28:57 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:28:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updating instance_info_cache with network_info: [{"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:28:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:28:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:28:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:28:59 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Instance spawned successfully.
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:28:59 user nova-compute[75102]: INFO nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Took 6.26 seconds to spawn the instance on the hypervisor.
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:28:59 user nova-compute[75102]: INFO nova.compute.manager [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Took 7.60 seconds to build instance.
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-62d57515-5397-4a0d-9fa1-398f2545e420 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.724s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-9080a8ce-a42f-4189-b712-64d30bc47cb4 req-f5687fe6-1855-454c-8eb6-999d1b20d80d service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9080a8ce-a42f-4189-b712-64d30bc47cb4 req-f5687fe6-1855-454c-8eb6-999d1b20d80d service nova] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9080a8ce-a42f-4189-b712-64d30bc47cb4 req-f5687fe6-1855-454c-8eb6-999d1b20d80d service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9080a8ce-a42f-4189-b712-64d30bc47cb4 req-f5687fe6-1855-454c-8eb6-999d1b20d80d service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-9080a8ce-a42f-4189-b712-64d30bc47cb4 req-f5687fe6-1855-454c-8eb6-999d1b20d80d service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] No waiting events found dispatching network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:28:59 user nova-compute[75102]: WARNING nova.compute.manager [req-9080a8ce-a42f-4189-b712-64d30bc47cb4 req-f5687fe6-1855-454c-8eb6-999d1b20d80d service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received unexpected event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 for instance with vm_state active and task_state None.
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:28:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue --force-share --output=json" returned: 0 in 0.262s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue --force-share --output=json" returned: 0 in 0.224s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.271s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:29:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.292s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:03 user nova-compute[75102]: INFO nova.compute.manager [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Terminating instance
Nov 10 16:29:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c/disk --force-share --output=json" returned: 0 in 0.320s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-5325ab87-5f29-46f8-8c54-48ff1d7f19a7 req-9b6968f9-c9ef-4fd7-aa02-3660cbca3cfb service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-unplugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5325ab87-5f29-46f8-8c54-48ff1d7f19a7 req-9b6968f9-c9ef-4fd7-aa02-3660cbca3cfb service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5325ab87-5f29-46f8-8c54-48ff1d7f19a7 req-9b6968f9-c9ef-4fd7-aa02-3660cbca3cfb service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5325ab87-5f29-46f8-8c54-48ff1d7f19a7 req-9b6968f9-c9ef-4fd7-aa02-3660cbca3cfb service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-5325ab87-5f29-46f8-8c54-48ff1d7f19a7 req-9b6968f9-c9ef-4fd7-aa02-3660cbca3cfb service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-unplugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-5325ab87-5f29-46f8-8c54-48ff1d7f19a7 req-9b6968f9-c9ef-4fd7-aa02-3660cbca3cfb service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-unplugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json" returned: 0 in 0.306s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:04 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Instance destroyed successfully.
Nov 10 16:29:04 user nova-compute[75102]: DEBUG nova.objects.instance [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'resources' on Instance uuid b1ffa0dd-1f28-40f1-83e1-4a677302483c {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:22:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-646812490',display_name='tempest-TestMinimumBasicScenario-server-646812490',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-646812490',id=14,image_ref='31966772-0b33-43d9-985a-3cd863a3f140',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNjtWoSsTuXJ+NecIc+HuGNvaUIUmHcwzGzDRU9W8SZjunZphg8d3+X9aqSrro8Y8PsmQnAUGCe5x/Av1TLTJIkCTIDnZrG5jKrew8OhuDihgqb6VnALGWyIwxRmqd8oew==',key_name='tempest-TestMinimumBasicScenario-1776384831',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:23:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3975de59dc974b5299a9765364645f24',ramdisk_id='',reservation_id='r-ejr1lcoz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='31966772-0b33-43d9-985a-3cd863a3f140',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-86254494',owner_user_name='tempest-TestMinimumBasicScenario-86254494-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:26:13Z,user_data=None,user_id='3a487c00935d4baa981cc8a1567af2a8',uuid=b1ffa0dd-1f28-40f1-83e1-4a677302483c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converting VIF {"id": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "address": "fa:16:3e:d3:d8:7a", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e6f20ff-75", "ovs_interfaceid": "2e6f20ff-75fe-49df-944c-ad4040cbdcb6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG os_vif [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e6f20ff-75, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e7eac42-96bb-44ac-a46d-d847624a0a79) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json" returned: 0 in 0.350s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:29:04 user nova-compute[75102]: INFO os_vif [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d3:d8:7a,bridge_name='br-int',has_traffic_filtering=True,id=2e6f20ff-75fe-49df-944c-ad4040cbdcb6,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e6f20ff-75')
Nov 10 16:29:04 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Deleting instance files /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c_del
Nov 10 16:29:04 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Deletion of /opt/stack/data/nova/instances/b1ffa0dd-1f28-40f1-83e1-4a677302483c_del complete
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:04 user nova-compute[75102]: INFO nova.compute.manager [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Took 1.27 seconds to destroy the instance on the hypervisor.
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json" returned: 0 in 0.338s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539/disk --force-share --output=json" returned: 0 in 0.281s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.302s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:29:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e/disk --force-share --output=json" returned: 0 in 0.329s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:05 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Took 1.08 seconds to deallocate network for instance.
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:06 user nova-compute[75102]: WARNING nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state deleted and task_state None.
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:06 user nova-compute[75102]: WARNING nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state deleted and task_state None.
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:06 user nova-compute[75102]: WARNING nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state deleted and task_state None.
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Acquiring lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] No waiting events found dispatching network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:06 user nova-compute[75102]: WARNING nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received unexpected event network-vif-plugged-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 for instance with vm_state deleted and task_state None.
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-835f8a89-06de-4732-b1cf-cba26fa09c93 req-f762ee22-67e1-4f84-b431-767797645107 service nova] [instance: b1ffa0dd-1f28-40f1-83e1-4a677302483c] Received event network-vif-deleted-2e6f20ff-75fe-49df-944c-ad4040cbdcb6 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:06 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:29:06 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7279MB free_disk=24.943206787109375GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.565s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.520s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:07 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Deleted allocations for instance b1ffa0dd-1f28-40f1-83e1-4a677302483c
Nov 10 16:29:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-96456408-9140-4d7f-8648-380652f63928 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "b1ffa0dd-1f28-40f1-83e1-4a677302483c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.704s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1d2937fc-16d6-4167-9b43-f0f44663deda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a437e642-d3a4-4356-805e-cb68da21167f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8475b9aa-13f8-4cf4-9636-743bee133121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ede4b1ad-5bee-498e-8692-08b00dfa323a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8fbbb791-da59-44ba-997c-0b0ff3957539 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6c571e41-3f17-40f4-bcbc-4f3f86585d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:29:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.750s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:29:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Creating image(s)
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Ensure instance console log exists: /opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Start _get_guest_xml network_info=[{"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7bb91a95-b74a-46d3-9f9f-a2958b36d3e2', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsxEXbNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6c571e41-3f17-40f4-bcbc-4f3f86585d3f', 'attached_at': '', 'detached_at': '', 'volume_id': 'daf0210e-15d3-4819-adb4-77d798e1bf62', 'serial': 'daf0210e-15d3-4819-adb4-77d798e1bf62'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:29:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:29:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsxEXbNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:29:09 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:29:09 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:29:09 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[70942981-3579-4dcb-900f-15e9a935fbb6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:29:09 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[64873eee-41ff-4e66-a397-7b23ca78727e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62] added
Nov 10 16:29:09 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.049s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8248aac4-4323-46c7-8b0c-7d528d1ae77a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[454be6a2-5bc3-41ea-871f-f0d56e537c35]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsxEXbNA {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsxEXbNA" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6313cb1b-51f5-43a3-ac89-19e33d976293]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZsxEXbNA'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d2d11d3-6332-4516-aaf3-8deb832f81e0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370bfa7-2279-464d-bc57-7dd2c88b6682]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3ff581-5b6a-43bf-89d6-45fddbd8acff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62, portal: 172.16.0.220,3260]
Nov 10 16:29:09 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62, portal: 172.16.0.220,3260] successful.
Nov 10 16:29:09 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[337c13a0-9cbe-49ac-bb7a-4d0e98c6c07c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.046s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d90bc60-4735-4d6d-bb2e-7ca87bdce0fe]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:29:09 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.363s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d52415b-2ca7-4b5d-9d7b-18e9d67c042e]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:29:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsxEXbNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.398s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '23739666364313833', 'path': '/dev/sde'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739666364313833', 'path': '/dev/sde'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-489219966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-489219966',id=27,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-8idszope',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:28:19Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=6c571e41-3f17-40f4-bcbc-4f3f86585d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:05,bridge_name='br-int',has_traffic_filtering=True,id=728d5a24-aa97-4f3f-b8b0-3436cdb1d100,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d5a24-aa') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:29:10 user nova-compute[75102]:   <uuid>6c571e41-3f17-40f4-bcbc-4f3f86585d3f</uuid>
Nov 10 16:29:10 user nova-compute[75102]:   <name>instance-0000001b</name>
Nov 10 16:29:10 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:29:10 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:29:10 user nova-compute[75102]:   <metadata>
Nov 10 16:29:10 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:29:10 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:29:10 user nova-compute[75102]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-489219966</nova:name>
Nov 10 16:29:10 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:29:09</nova:creationTime>
Nov 10 16:29:10 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:29:10 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:29:10 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:29:10 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:29:10 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:29:10 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:29:10 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:29:10 user nova-compute[75102]:       <nova:owner>
Nov 10 16:29:10 user nova-compute[75102]:         <nova:user uuid="3149d0620bf64829aa4eec99a2cddee5">tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member</nova:user>
Nov 10 16:29:10 user nova-compute[75102]:         <nova:project uuid="c0e926f56f914e7488a50f5bb78a33cd">tempest-ServerBootFromVolumeStableRescueTest-918868864</nova:project>
Nov 10 16:29:10 user nova-compute[75102]:       </nova:owner>
Nov 10 16:29:10 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:29:10 user nova-compute[75102]:       <nova:ports>
Nov 10 16:29:10 user nova-compute[75102]:         <nova:port uuid="728d5a24-aa97-4f3f-b8b0-3436cdb1d100">
Nov 10 16:29:10 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:29:10 user nova-compute[75102]:         </nova:port>
Nov 10 16:29:10 user nova-compute[75102]:       </nova:ports>
Nov 10 16:29:10 user nova-compute[75102]:     </nova:instance>
Nov 10 16:29:10 user nova-compute[75102]:   </metadata>
Nov 10 16:29:10 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:29:10 user nova-compute[75102]:     <system>
Nov 10 16:29:10 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:29:10 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:29:10 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:29:10 user nova-compute[75102]:       <entry name="serial">6c571e41-3f17-40f4-bcbc-4f3f86585d3f</entry>
Nov 10 16:29:10 user nova-compute[75102]:       <entry name="uuid">6c571e41-3f17-40f4-bcbc-4f3f86585d3f</entry>
Nov 10 16:29:10 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:29:10 user nova-compute[75102]:     </system>
Nov 10 16:29:10 user nova-compute[75102]:   </sysinfo>
Nov 10 16:29:10 user nova-compute[75102]:   <os>
Nov 10 16:29:10 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:29:10 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:29:10 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:29:10 user nova-compute[75102]:   </os>
Nov 10 16:29:10 user nova-compute[75102]:   <features>
Nov 10 16:29:10 user nova-compute[75102]:     <acpi/>
Nov 10 16:29:10 user nova-compute[75102]:     <apic/>
Nov 10 16:29:10 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:29:10 user nova-compute[75102]:   </features>
Nov 10 16:29:10 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:29:10 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:29:10 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:29:10 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:29:10 user nova-compute[75102]:   </clock>
Nov 10 16:29:10 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:29:10 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:29:10 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:29:10 user nova-compute[75102]:   </cpu>
Nov 10 16:29:10 user nova-compute[75102]:   <devices>
Nov 10 16:29:10 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:29:10 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:29:10 user nova-compute[75102]:       <source dev="/dev/sde"/>
Nov 10 16:29:10 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:29:10 user nova-compute[75102]:       <serial>daf0210e-15d3-4819-adb4-77d798e1bf62</serial>
Nov 10 16:29:10 user nova-compute[75102]:     </disk>
Nov 10 16:29:10 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:29:10 user nova-compute[75102]:       <mac address="fa:16:3e:b1:9e:05"/>
Nov 10 16:29:10 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:29:10 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:29:10 user nova-compute[75102]:       <target dev="tap728d5a24-aa"/>
Nov 10 16:29:10 user nova-compute[75102]:     </interface>
Nov 10 16:29:10 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:29:10 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/console.log" append="off"/>
Nov 10 16:29:10 user nova-compute[75102]:     </serial>
Nov 10 16:29:10 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:29:10 user nova-compute[75102]:     <video>
Nov 10 16:29:10 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:29:10 user nova-compute[75102]:     </video>
Nov 10 16:29:10 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:29:10 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:29:10 user nova-compute[75102]:     </rng>
Nov 10 16:29:10 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:29:10 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:29:10 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:29:10 user nova-compute[75102]:     </memballoon>
Nov 10 16:29:10 user nova-compute[75102]:   </devices>
Nov 10 16:29:10 user nova-compute[75102]: </domain>
Nov 10 16:29:10 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-489219966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-489219966',id=27,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-8idszope',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:28:19Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=6c571e41-3f17-40f4-bcbc-4f3f86585d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:05,bridge_name='br-int',has_traffic_filtering=True,id=728d5a24-aa97-4f3f-b8b0-3436cdb1d100,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d5a24-aa') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG os_vif [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:05,bridge_name='br-int',has_traffic_filtering=True,id=728d5a24-aa97-4f3f-b8b0-3436cdb1d100,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d5a24-aa') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '59285416-8f86-5c73-9cc5-c2671e4934bc', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap728d5a24-aa, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap728d5a24-aa, col_values=(('qos', UUID('1bc36e94-b268-447e-b6a9-decb5e256531')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap728d5a24-aa, col_values=(('external_ids', {'iface-id': '728d5a24-aa97-4f3f-b8b0-3436cdb1d100', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:9e:05', 'vm-uuid': '6c571e41-3f17-40f4-bcbc-4f3f86585d3f'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:10 user nova-compute[75102]: INFO os_vif [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:9e:05,bridge_name='br-int',has_traffic_filtering=True,id=728d5a24-aa97-4f3f-b8b0-3436cdb1d100,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d5a24-aa')
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:29:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No VIF found with MAC fa:16:3e:b1:9e:05, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:29:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-6ec16d63-aa93-4147-af15-0b9674ed1159 req-c86f2e8f-c188-45b4-9d96-b901ee29a2f4 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6ec16d63-aa93-4147-af15-0b9674ed1159 req-c86f2e8f-c188-45b4-9d96-b901ee29a2f4 service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6ec16d63-aa93-4147-af15-0b9674ed1159 req-c86f2e8f-c188-45b4-9d96-b901ee29a2f4 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6ec16d63-aa93-4147-af15-0b9674ed1159 req-c86f2e8f-c188-45b4-9d96-b901ee29a2f4 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-6ec16d63-aa93-4147-af15-0b9674ed1159 req-c86f2e8f-c188-45b4-9d96-b901ee29a2f4 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:12 user nova-compute[75102]: WARNING nova.compute.manager [req-6ec16d63-aa93-4147-af15-0b9674ed1159 req-c86f2e8f-c188-45b4-9d96-b901ee29a2f4 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state building and task_state spawning.
Nov 10 16:29:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:13 user nova-compute[75102]: INFO nova.compute.manager [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Terminating instance
Nov 10 16:29:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-1824dd0e-b193-4b81-98e4-2548a71708e8 req-4e4c1dcd-9129-4dec-a782-6e7fe170b252 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received event network-vif-unplugged-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1824dd0e-b193-4b81-98e4-2548a71708e8 req-4e4c1dcd-9129-4dec-a782-6e7fe170b252 service nova] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1824dd0e-b193-4b81-98e4-2548a71708e8 req-4e4c1dcd-9129-4dec-a782-6e7fe170b252 service nova] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1824dd0e-b193-4b81-98e4-2548a71708e8 req-4e4c1dcd-9129-4dec-a782-6e7fe170b252 service nova] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-1824dd0e-b193-4b81-98e4-2548a71708e8 req-4e4c1dcd-9129-4dec-a782-6e7fe170b252 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] No waiting events found dispatching network-vif-unplugged-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-1824dd0e-b193-4b81-98e4-2548a71708e8 req-4e4c1dcd-9129-4dec-a782-6e7fe170b252 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received event network-vif-unplugged-c0200ac3-e977-497b-958b-c0abe0030166 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Instance destroyed successfully.
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lazy-loading 'resources' on Instance uuid e4c81c8e-88f5-4789-8f0a-034965ec6f5e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:22:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1142194967',display_name='tempest-VolumesAdminNegativeTest-server-1142194967',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1142194967',id=13,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJA7d6FjjU6j3Dfak75FjKZ4vc5bedosW1fEUbjJWHclvqgSiXjN/TfPuTpJgeg63aC+6yh1VVfwB/MFmn0Ge9/hUfzW1S4+wNEEFvElz9Abv04+WceiCrW6ikP/7Xlqw==',key_name='tempest-keypair-385827681',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:22:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6ce78721e684c9581fba3a8412b6ac5',ramdisk_id='',reservation_id='r-2xlooi7u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1261870727',owner_user_name='tempest-VolumesAdminNegativeTest-1261870727-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:22:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1471fdc4198b43adbdadb762d584acc6',uuid=e4c81c8e-88f5-4789-8f0a-034965ec6f5e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converting VIF {"id": "c0200ac3-e977-497b-958b-c0abe0030166", "address": "fa:16:3e:29:7d:ec", "network": {"id": "1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1293436030-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6ce78721e684c9581fba3a8412b6ac5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc0200ac3-e9", "ovs_interfaceid": "c0200ac3-e977-497b-958b-c0abe0030166", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:29:7d:ec,bridge_name='br-int',has_traffic_filtering=True,id=c0200ac3-e977-497b-958b-c0abe0030166,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0200ac3-e9') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG os_vif [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:7d:ec,bridge_name='br-int',has_traffic_filtering=True,id=c0200ac3-e977-497b-958b-c0abe0030166,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0200ac3-e9') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc0200ac3-e9, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=05693a3f-1feb-4b9a-bf2f-0884ca2f3149) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:14 user nova-compute[75102]: INFO os_vif [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:29:7d:ec,bridge_name='br-int',has_traffic_filtering=True,id=c0200ac3-e977-497b-958b-c0abe0030166,network=Network(1c9ddba9-1b25-40c4-ac03-6b0cf9de4d47),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc0200ac3-e9')
Nov 10 16:29:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Deleting instance files /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e_del
Nov 10 16:29:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Deletion of /opt/stack/data/nova/instances/e4c81c8e-88f5-4789-8f0a-034965ec6f5e_del complete
Nov 10 16:29:14 user nova-compute[75102]: INFO nova.compute.manager [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Took 1.08 seconds to destroy the instance on the hypervisor.
Nov 10 16:29:14 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-0ebe1437-c3e1-4c91-a8af-15984b2740b9 req-6cdd54d7-b07a-4fa5-891f-e11b394f4671 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0ebe1437-c3e1-4c91-a8af-15984b2740b9 req-6cdd54d7-b07a-4fa5-891f-e11b394f4671 service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0ebe1437-c3e1-4c91-a8af-15984b2740b9 req-6cdd54d7-b07a-4fa5-891f-e11b394f4671 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0ebe1437-c3e1-4c91-a8af-15984b2740b9 req-6cdd54d7-b07a-4fa5-891f-e11b394f4671 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-0ebe1437-c3e1-4c91-a8af-15984b2740b9 req-6cdd54d7-b07a-4fa5-891f-e11b394f4671 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:14 user nova-compute[75102]: WARNING nova.compute.manager [req-0ebe1437-c3e1-4c91-a8af-15984b2740b9 req-6cdd54d7-b07a-4fa5-891f-e11b394f4671 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state building and task_state spawning.
Nov 10 16:29:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:29:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Instance spawned successfully.
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:29:14 user nova-compute[75102]: INFO nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Took 5.54 seconds to spawn the instance on the hypervisor.
Nov 10 16:29:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:29:14 user nova-compute[75102]: INFO nova.compute.manager [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Took 56.73 seconds to build instance.
Nov 10 16:29:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3d87f7cb-50ec-4662-b1b6-89559af9108f tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 56.823s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:15 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:29:15 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Took 1.18 seconds to deallocate network for instance.
Nov 10 16:29:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-e35f770a-d5aa-4728-b19c-c0faf0b91400 req-0926348c-64be-4f30-bf4a-a352b3371384 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received event network-vif-plugged-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e35f770a-d5aa-4728-b19c-c0faf0b91400 req-0926348c-64be-4f30-bf4a-a352b3371384 service nova] Acquiring lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e35f770a-d5aa-4728-b19c-c0faf0b91400 req-0926348c-64be-4f30-bf4a-a352b3371384 service nova] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e35f770a-d5aa-4728-b19c-c0faf0b91400 req-0926348c-64be-4f30-bf4a-a352b3371384 service nova] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-e35f770a-d5aa-4728-b19c-c0faf0b91400 req-0926348c-64be-4f30-bf4a-a352b3371384 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] No waiting events found dispatching network-vif-plugged-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:15 user nova-compute[75102]: WARNING nova.compute.manager [req-e35f770a-d5aa-4728-b19c-c0faf0b91400 req-0926348c-64be-4f30-bf4a-a352b3371384 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received unexpected event network-vif-plugged-c0200ac3-e977-497b-958b-c0abe0030166 for instance with vm_state deleted and task_state None.
Nov 10 16:29:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-e35f770a-d5aa-4728-b19c-c0faf0b91400 req-0926348c-64be-4f30-bf4a-a352b3371384 service nova] [instance: e4c81c8e-88f5-4789-8f0a-034965ec6f5e] Received event network-vif-deleted-c0200ac3-e977-497b-958b-c0abe0030166 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:16 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:29:16 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:29:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.498s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:16 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Deleted allocations for instance e4c81c8e-88f5-4789-8f0a-034965ec6f5e
Nov 10 16:29:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c05f80e7-d56a-45af-b0cc-2f9c2ca4b6c7 tempest-VolumesAdminNegativeTest-1261870727 tempest-VolumesAdminNegativeTest-1261870727-project-member] Lock "e4c81c8e-88f5-4789-8f0a-034965ec6f5e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:25 user nova-compute[75102]: INFO nova.compute.manager [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Terminating instance
Nov 10 16:29:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef50b67-768e-4cf8-8e5b-220d139d4ac2 req-f145516b-fa2e-4a03-9b8f-634813cb69d3 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-vif-unplugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef50b67-768e-4cf8-8e5b-220d139d4ac2 req-f145516b-fa2e-4a03-9b8f-634813cb69d3 service nova] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef50b67-768e-4cf8-8e5b-220d139d4ac2 req-f145516b-fa2e-4a03-9b8f-634813cb69d3 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef50b67-768e-4cf8-8e5b-220d139d4ac2 req-f145516b-fa2e-4a03-9b8f-634813cb69d3 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef50b67-768e-4cf8-8e5b-220d139d4ac2 req-f145516b-fa2e-4a03-9b8f-634813cb69d3 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] No waiting events found dispatching network-vif-unplugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef50b67-768e-4cf8-8e5b-220d139d4ac2 req-f145516b-fa2e-4a03-9b8f-634813cb69d3 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-vif-unplugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Instance destroyed successfully.
Nov 10 16:29:26 user nova-compute[75102]: DEBUG nova.objects.instance [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lazy-loading 'resources' on Instance uuid ede4b1ad-5bee-498e-8692-08b00dfa323a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:27:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-650362378',display_name='tempest-VolumesActionsTest-instance-650362378',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-650362378',id=25,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:27:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2bfa048a64b74cef84d4645eb627c0eb',ramdisk_id='',reservation_id='r-5rxk0vfr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-880387838',owner_user_name='tempest-VolumesActionsTest-880387838-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:27:42Z,user_data=None,user_id='1c97d44d1a1a4d3ba6f7e4f7f57dcbee',uuid=ede4b1ad-5bee-498e-8692-08b00dfa323a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converting VIF {"id": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "address": "fa:16:3e:b1:5e:49", "network": {"id": "0628bc2a-04af-43c3-9e10-f437c7d85661", "bridge": "br-int", "label": "tempest-VolumesActionsTest-647781590-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2bfa048a64b74cef84d4645eb627c0eb", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2c8f706a-97", "ovs_interfaceid": "2c8f706a-9786-4b8d-b2cf-d8b80210abb5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5e:49,bridge_name='br-int',has_traffic_filtering=True,id=2c8f706a-9786-4b8d-b2cf-d8b80210abb5,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f706a-97') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG os_vif [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5e:49,bridge_name='br-int',has_traffic_filtering=True,id=2c8f706a-9786-4b8d-b2cf-d8b80210abb5,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f706a-97') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2c8f706a-97, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d3417753-3eaa-42e2-9439-c2c315fe4f28) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: INFO os_vif [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:5e:49,bridge_name='br-int',has_traffic_filtering=True,id=2c8f706a-9786-4b8d-b2cf-d8b80210abb5,network=Network(0628bc2a-04af-43c3-9e10-f437c7d85661),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2c8f706a-97')
Nov 10 16:29:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Deleting instance files /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a_del
Nov 10 16:29:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Deletion of /opt/stack/data/nova/instances/ede4b1ad-5bee-498e-8692-08b00dfa323a_del complete
Nov 10 16:29:26 user nova-compute[75102]: INFO nova.compute.manager [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 16:29:26 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:27 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:29:27 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Took 0.76 seconds to deallocate network for instance.
Nov 10 16:29:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:27 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:29:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:29:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.467s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:27 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Deleted allocations for instance ede4b1ad-5bee-498e-8692-08b00dfa323a
Nov 10 16:29:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-25fbf80a-ff29-4b13-8d09-7528c4299d58 tempest-VolumesActionsTest-880387838 tempest-VolumesActionsTest-880387838-project-member] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.314s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] No waiting events found dispatching network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:28 user nova-compute[75102]: WARNING nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received unexpected event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 for instance with vm_state deleted and task_state None.
Nov 10 16:29:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] No waiting events found dispatching network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:28 user nova-compute[75102]: WARNING nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received unexpected event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 for instance with vm_state deleted and task_state None.
Nov 10 16:29:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] No waiting events found dispatching network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:28 user nova-compute[75102]: WARNING nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received unexpected event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 for instance with vm_state deleted and task_state None.
Nov 10 16:29:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-vif-deleted-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Acquiring lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] Lock "ede4b1ad-5bee-498e-8692-08b00dfa323a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] No waiting events found dispatching network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:28 user nova-compute[75102]: WARNING nova.compute.manager [req-8ff51156-aaef-4104-aad1-8398ad37b83e req-4b543198-8c1f-4ed9-a99e-72d2b0223400 service nova] [instance: ede4b1ad-5bee-498e-8692-08b00dfa323a] Received unexpected event network-vif-plugged-2c8f706a-9786-4b8d-b2cf-d8b80210abb5 for instance with vm_state deleted and task_state None.
Nov 10 16:29:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-b00156c2-1009-41c1-8ecb-b3c05b0aba86 req-5b2319fd-176e-42cb-955a-df9de0fd5bb6 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-changed-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-b00156c2-1009-41c1-8ecb-b3c05b0aba86 req-5b2319fd-176e-42cb-955a-df9de0fd5bb6 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Refreshing instance network info cache due to event network-changed-02c4e33c-815c-4ffb-bdd0-3bade65e8345. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b00156c2-1009-41c1-8ecb-b3c05b0aba86 req-5b2319fd-176e-42cb-955a-df9de0fd5bb6 service nova] Acquiring lock "refresh_cache-8fbbb791-da59-44ba-997c-0b0ff3957539" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b00156c2-1009-41c1-8ecb-b3c05b0aba86 req-5b2319fd-176e-42cb-955a-df9de0fd5bb6 service nova] Acquired lock "refresh_cache-8fbbb791-da59-44ba-997c-0b0ff3957539" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG nova.network.neutron [req-b00156c2-1009-41c1-8ecb-b3c05b0aba86 req-5b2319fd-176e-42cb-955a-df9de0fd5bb6 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Refreshing network info cache for port 02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:29 user nova-compute[75102]: INFO nova.compute.manager [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Terminating instance
Nov 10 16:29:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG nova.network.neutron [req-b00156c2-1009-41c1-8ecb-b3c05b0aba86 req-5b2319fd-176e-42cb-955a-df9de0fd5bb6 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Updated VIF entry in instance network info cache for port 02c4e33c-815c-4ffb-bdd0-3bade65e8345. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG nova.network.neutron [req-b00156c2-1009-41c1-8ecb-b3c05b0aba86 req-5b2319fd-176e-42cb-955a-df9de0fd5bb6 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Updating instance_info_cache with network_info: [{"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b00156c2-1009-41c1-8ecb-b3c05b0aba86 req-5b2319fd-176e-42cb-955a-df9de0fd5bb6 service nova] Releasing lock "refresh_cache-8fbbb791-da59-44ba-997c-0b0ff3957539" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-b94dfc9d-1e28-4d6e-8b54-15043053b9f4 req-b4b92460-63d8-44e4-8f89-e0344313b0d8 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-unplugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b94dfc9d-1e28-4d6e-8b54-15043053b9f4 req-b4b92460-63d8-44e4-8f89-e0344313b0d8 service nova] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b94dfc9d-1e28-4d6e-8b54-15043053b9f4 req-b4b92460-63d8-44e4-8f89-e0344313b0d8 service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b94dfc9d-1e28-4d6e-8b54-15043053b9f4 req-b4b92460-63d8-44e4-8f89-e0344313b0d8 service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-b94dfc9d-1e28-4d6e-8b54-15043053b9f4 req-b4b92460-63d8-44e4-8f89-e0344313b0d8 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] No waiting events found dispatching network-vif-unplugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-b94dfc9d-1e28-4d6e-8b54-15043053b9f4 req-b4b92460-63d8-44e4-8f89-e0344313b0d8 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-unplugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Instance destroyed successfully.
Nov 10 16:29:30 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'resources' on Instance uuid 8fbbb791-da59-44ba-997c-0b0ff3957539 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:27:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1594019203',display_name='tempest-AttachVolumeNegativeTest-server-1594019203',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1594019203',id=26,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBeW+FNwj9Ik+g8BSr/64AeFFcNYUfvateMePx/nJBwIlFaG2NXTbrZYcADg64M973SfPXXJdQPCcFL7vZNvrshUqwdhwKs0m3b9YXDge4pD2y+g68kRaN4Jn+rAoxb1Nw==',key_name='tempest-keypair-493807276',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:27:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-1dux8wyu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:27:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=8fbbb791-da59-44ba-997c-0b0ff3957539,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "address": "fa:16:3e:e1:3f:c3", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02c4e33c-81", "ovs_interfaceid": "02c4e33c-815c-4ffb-bdd0-3bade65e8345", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=02c4e33c-815c-4ffb-bdd0-3bade65e8345,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c4e33c-81') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG os_vif [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=02c4e33c-815c-4ffb-bdd0-3bade65e8345,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c4e33c-81') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02c4e33c-81, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca07438e-171f-45e5-b37e-774b48da65cf) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:29:30 user nova-compute[75102]: INFO os_vif [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e1:3f:c3,bridge_name='br-int',has_traffic_filtering=True,id=02c4e33c-815c-4ffb-bdd0-3bade65e8345,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02c4e33c-81')
Nov 10 16:29:30 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Deleting instance files /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539_del
Nov 10 16:29:30 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Deletion of /opt/stack/data/nova/instances/8fbbb791-da59-44ba-997c-0b0ff3957539_del complete
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: INFO nova.compute.manager [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Took 0.82 seconds to destroy the instance on the hypervisor.
Nov 10 16:29:30 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:29:31 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Took 0.96 seconds to deallocate network for instance.
Nov 10 16:29:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-b73a68dc-b656-4800-b463-001b5fe86c17 req-59cf9e6f-f95c-442a-b9d1-3c3d89261430 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-deleted-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:31 user nova-compute[75102]: INFO nova.compute.manager [req-b73a68dc-b656-4800-b463-001b5fe86c17 req-59cf9e6f-f95c-442a-b9d1-3c3d89261430 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Neutron deleted interface 02c4e33c-815c-4ffb-bdd0-3bade65e8345; detaching it from the instance and deleting it from the info cache
Nov 10 16:29:31 user nova-compute[75102]: DEBUG nova.network.neutron [req-b73a68dc-b656-4800-b463-001b5fe86c17 req-59cf9e6f-f95c-442a-b9d1-3c3d89261430 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-b73a68dc-b656-4800-b463-001b5fe86c17 req-59cf9e6f-f95c-442a-b9d1-3c3d89261430 service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Detach interface failed, port_id=02c4e33c-815c-4ffb-bdd0-3bade65e8345, reason: Instance 8fbbb791-da59-44ba-997c-0b0ff3957539 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiJRAkex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:29:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:29:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:29:31 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e431e96-b485-43e5-9be0-ff20705c3b9d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:29:31 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b43b68-0901-46d3-8bb5-8817c77b5114]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241] added
Nov 10 16:29:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b99dd4-19f3-4f44-b263-d788731fdbb8]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6a305f-788b-4e19-9c0f-fd3f617f3c31]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DiJRAkex {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DiJRAkex" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a826281a-e332-44c0-8d54-8b4d7044e1d5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DiJRAkex'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e937148-1902-4208-9b6e-0af79058359f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.413s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d9c0f-8d64-4d09-97df-bb5705114423]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:29:31 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:29:31 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:29:31 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:29:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:29:31 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:29:31 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:29:31 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:29:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Deleted allocations for instance 8fbbb791-da59-44ba-997c-0b0ff3957539
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b89248-f588-4094-a7c6-a3c5671df5dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241, portal: 172.16.0.220,3260]
Nov 10 16:29:31 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241, portal: 172.16.0.220,3260] successful.
Nov 10 16:29:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f65c03d1-ff1a-4434-9ebe-02e4b5755d44]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3090f1b-d261-4a37-b9ae-5bb95832d887 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.433s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] No waiting events found dispatching network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:32 user nova-compute[75102]: WARNING nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received unexpected event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 for instance with vm_state deleted and task_state None.
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] No waiting events found dispatching network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:32 user nova-compute[75102]: WARNING nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received unexpected event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 for instance with vm_state deleted and task_state None.
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] No waiting events found dispatching network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:32 user nova-compute[75102]: WARNING nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received unexpected event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 for instance with vm_state deleted and task_state None.
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-unplugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] No waiting events found dispatching network-vif-unplugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:32 user nova-compute[75102]: WARNING nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received unexpected event network-vif-unplugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 for instance with vm_state deleted and task_state None.
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Acquiring lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] Lock "8fbbb791-da59-44ba-997c-0b0ff3957539-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] No waiting events found dispatching network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:29:32 user nova-compute[75102]: WARNING nova.compute.manager [req-10c55ed6-c7fc-4e16-9c36-6d8350010257 req-dde90fa0-4e90-41ed-b5f5-61432cf7b2fe service nova] [instance: 8fbbb791-da59-44ba-997c-0b0ff3957539] Received unexpected event network-vif-plugged-02c4e33c-815c-4ffb-bdd0-3bade65e8345 for instance with vm_state deleted and task_state None.
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f48a31-f469-4cc2-9f5c-4a929148de01]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:29:32 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:29:32 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:29:32 user nova-compute[75102]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)
Nov 10 16:29:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:29:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:29:32 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:29:32 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:29:32 user nova-compute[75102]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)
Nov 10 16:29:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:29:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.338s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] HCTL ('37', '-', '-', 0) found on session 24 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea443273-03f8-4cdb-a376-6c62590fbddf]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Searching for a device in session 24 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiJRAkex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.386s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26231636530396665', 'path': '/dev/sdf'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26231636530396665', 'path': '/dev/sdf'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG nova.objects.instance [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'flavor' on Instance uuid 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:29:33 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:29:33 user nova-compute[75102]:   <source dev="/dev/sdf"/>
Nov 10 16:29:33 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:29:33 user nova-compute[75102]:   <serial>382719ab-3240-420a-bde6-49e68ac50241</serial>
Nov 10 16:29:33 user nova-compute[75102]: </disk>
Nov 10 16:29:33 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No VIF found with MAC fa:16:3e:d4:75:b3, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:29:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80aff88f-c576-4b29-8e09-814e07541404 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 41.494s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG nova.objects.instance [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'flavor' on Instance uuid 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:41 user nova-compute[75102]: INFO nova.compute.manager [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Attaching volume 8103a4ac-edc2-4754-9193-e411c51aa4ea to /dev/vdc
Nov 10 16:29:41 user nova-compute[75102]: DEBUG os_brick.utils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[881a04ca-0ca0-4daa-87d6-7469a30d8c68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0437bc2-70af-465f-a8db-8b1831f19dc6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9427d7e0-5bcf-40bc-b6e9-de2a0f723b14]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3634435-cd2a-40af-8bbc-4b7dc2f770ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:29:41 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:29:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebc4a0a-b629-42e8-87f6-9370303db9ca]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG os_brick.utils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:29:41 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Updating existing volume attachment record: 8462e775-beb9-4ae1-be19-023fbc888478 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:29:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:54 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:54 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:29:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:29:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:29:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:29:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:56 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:29:58 user nova-compute[75102]: INFO nova.compute.claims [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Claim successful on node user
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:29:58 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.policy [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3a487c00935d4baa981cc8a1567af2a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3975de59dc974b5299a9765364645f24', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:29:58 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Creating image(s)
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "/opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "/opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "/opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904.part --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updating instance_info_cache with network_info: [{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG nova.network.neutron [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Successfully created port: c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904.part --force-share --output=json" returned: 0 in 0.245s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG nova.virt.images [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] 9c0f285c-c603-4b57-b5a5-81646ab4f6f6 was qcow2, converting to raw {{(pid=75102) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:29:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904.part /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904.converted {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904.part /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904.converted" returned: 0 in 0.541s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904.converted --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904.converted --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.420s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Successfully updated port: c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquired lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-c6ad21a2-8f22-47c8-95d7-37be2cdf9db4 req-bef30716-193c-45a8-aa09-249d23f9c3ab service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-c6ad21a2-8f22-47c8-95d7-37be2cdf9db4 req-bef30716-193c-45a8-aa09-249d23f9c3ab service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing instance network info cache due to event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c6ad21a2-8f22-47c8-95d7-37be2cdf9db4 req-bef30716-193c-45a8-aa09-249d23f9c3ab service nova] Acquiring lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904 --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904 --force-share --output=json" returned: 0 in 0.219s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904,backing_fmt=raw /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk.rescue --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904,backing_fmt=raw /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk 1073741824" returned: 0 in 0.054s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.network.neutron [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updating instance_info_cache with network_info: [{"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904 --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Releasing lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Instance network_info: |[{"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c6ad21a2-8f22-47c8-95d7-37be2cdf9db4 req-bef30716-193c-45a8-aa09-249d23f9c3ab service nova] Acquired lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.network.neutron [req-c6ad21a2-8f22-47c8-95d7-37be2cdf9db4 req-bef30716-193c-45a8-aa09-249d23f9c3ab service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Cannot resize image /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Ensure instance console log exists: /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Start _get_guest_xml network_info=[{"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:29:55Z,direct_url=<?>,disk_format='qcow2',id=9c0f285c-c603-4b57-b5a5-81646ab4f6f6,min_disk=0,min_ram=0,name='tempest-scenario-img--1880187670',owner='3975de59dc974b5299a9765364645f24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:29:57Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': '9c0f285c-c603-4b57-b5a5-81646ab4f6f6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:30:01 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:30:01 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:29:55Z,direct_url=<?>,disk_format='qcow2',id=9c0f285c-c603-4b57-b5a5-81646ab4f6f6,min_disk=0,min_ram=0,name='tempest-scenario-img--1880187670',owner='3975de59dc974b5299a9765364645f24',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:29:57Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2117035397',display_name='tempest-TestMinimumBasicScenario-server-2117035397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2117035397',id=29,image_ref='9c0f285c-c603-4b57-b5a5-81646ab4f6f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ2C6VI0o+n/Ec/80gaXDO47lApEJiNU8WtQ8RoqCNzDoTFAVxHoZNY1N5UkWmNf1QXwDEXdk8QWQrrDg/Gu8ulW6Trg6rtM3/srDEnYqeMbpHbRa8/op6g/YM9aXJi5g==',key_name='tempest-TestMinimumBasicScenario-397374048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3975de59dc974b5299a9765364645f24',ramdisk_id='',reservation_id='r-gkgs93oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c0f285c-c603-4b57-b5a5-81646ab4f6f6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-86254494',owner_user_name='tempest-TestMinimumBasicScenario-86254494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:29:59Z,user_data=None,user_id='3a487c00935d4baa981cc8a1567af2a8',uuid=c34e2e7a-11a3-4718-9d67-f3eab7f21e4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converting VIF {"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:3c,bridge_name='br-int',has_traffic_filtering=True,id=c887ac21-4c60-4ba5-8c1b-1fcfae69e385,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc887ac21-4c') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.objects.instance [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'pci_devices' on Instance uuid c34e2e7a-11a3-4718-9d67-f3eab7f21e4b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:30:01 user nova-compute[75102]:   <uuid>c34e2e7a-11a3-4718-9d67-f3eab7f21e4b</uuid>
Nov 10 16:30:01 user nova-compute[75102]:   <name>instance-0000001d</name>
Nov 10 16:30:01 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:30:01 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:30:01 user nova-compute[75102]:   <metadata>
Nov 10 16:30:01 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:30:01 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:30:01 user nova-compute[75102]:       <nova:name>tempest-TestMinimumBasicScenario-server-2117035397</nova:name>
Nov 10 16:30:01 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:30:01</nova:creationTime>
Nov 10 16:30:01 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:30:01 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:30:01 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:30:01 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:30:01 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:30:01 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:30:01 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:30:01 user nova-compute[75102]:       <nova:owner>
Nov 10 16:30:01 user nova-compute[75102]:         <nova:user uuid="3a487c00935d4baa981cc8a1567af2a8">tempest-TestMinimumBasicScenario-86254494-project-member</nova:user>
Nov 10 16:30:01 user nova-compute[75102]:         <nova:project uuid="3975de59dc974b5299a9765364645f24">tempest-TestMinimumBasicScenario-86254494</nova:project>
Nov 10 16:30:01 user nova-compute[75102]:       </nova:owner>
Nov 10 16:30:01 user nova-compute[75102]:       <nova:root type="image" uuid="9c0f285c-c603-4b57-b5a5-81646ab4f6f6"/>
Nov 10 16:30:01 user nova-compute[75102]:       <nova:ports>
Nov 10 16:30:01 user nova-compute[75102]:         <nova:port uuid="c887ac21-4c60-4ba5-8c1b-1fcfae69e385">
Nov 10 16:30:01 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 16:30:01 user nova-compute[75102]:         </nova:port>
Nov 10 16:30:01 user nova-compute[75102]:       </nova:ports>
Nov 10 16:30:01 user nova-compute[75102]:     </nova:instance>
Nov 10 16:30:01 user nova-compute[75102]:   </metadata>
Nov 10 16:30:01 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:30:01 user nova-compute[75102]:     <system>
Nov 10 16:30:01 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:30:01 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:30:01 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:30:01 user nova-compute[75102]:       <entry name="serial">c34e2e7a-11a3-4718-9d67-f3eab7f21e4b</entry>
Nov 10 16:30:01 user nova-compute[75102]:       <entry name="uuid">c34e2e7a-11a3-4718-9d67-f3eab7f21e4b</entry>
Nov 10 16:30:01 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:30:01 user nova-compute[75102]:     </system>
Nov 10 16:30:01 user nova-compute[75102]:   </sysinfo>
Nov 10 16:30:01 user nova-compute[75102]:   <os>
Nov 10 16:30:01 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:30:01 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:30:01 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:30:01 user nova-compute[75102]:   </os>
Nov 10 16:30:01 user nova-compute[75102]:   <features>
Nov 10 16:30:01 user nova-compute[75102]:     <acpi/>
Nov 10 16:30:01 user nova-compute[75102]:     <apic/>
Nov 10 16:30:01 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:30:01 user nova-compute[75102]:   </features>
Nov 10 16:30:01 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:30:01 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:30:01 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:30:01 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:30:01 user nova-compute[75102]:   </clock>
Nov 10 16:30:01 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:30:01 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:30:01 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:30:01 user nova-compute[75102]:   </cpu>
Nov 10 16:30:01 user nova-compute[75102]:   <devices>
Nov 10 16:30:01 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:30:01 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:30:01 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk"/>
Nov 10 16:30:01 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:30:01 user nova-compute[75102]:     </disk>
Nov 10 16:30:01 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:30:01 user nova-compute[75102]:       <mac address="fa:16:3e:b9:84:3c"/>
Nov 10 16:30:01 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:30:01 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:30:01 user nova-compute[75102]:       <target dev="tapc887ac21-4c"/>
Nov 10 16:30:01 user nova-compute[75102]:     </interface>
Nov 10 16:30:01 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:30:01 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/console.log" append="off"/>
Nov 10 16:30:01 user nova-compute[75102]:     </serial>
Nov 10 16:30:01 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:30:01 user nova-compute[75102]:     <video>
Nov 10 16:30:01 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:30:01 user nova-compute[75102]:     </video>
Nov 10 16:30:01 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:30:01 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:30:01 user nova-compute[75102]:     </rng>
Nov 10 16:30:01 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:30:01 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:30:01 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:30:01 user nova-compute[75102]:     </memballoon>
Nov 10 16:30:01 user nova-compute[75102]:   </devices>
Nov 10 16:30:01 user nova-compute[75102]: </domain>
Nov 10 16:30:01 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2117035397',display_name='tempest-TestMinimumBasicScenario-server-2117035397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2117035397',id=29,image_ref='9c0f285c-c603-4b57-b5a5-81646ab4f6f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ2C6VI0o+n/Ec/80gaXDO47lApEJiNU8WtQ8RoqCNzDoTFAVxHoZNY1N5UkWmNf1QXwDEXdk8QWQrrDg/Gu8ulW6Trg6rtM3/srDEnYqeMbpHbRa8/op6g/YM9aXJi5g==',key_name='tempest-TestMinimumBasicScenario-397374048',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3975de59dc974b5299a9765364645f24',ramdisk_id='',reservation_id='r-gkgs93oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c0f285c-c603-4b57-b5a5-81646ab4f6f6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-86254494',owner_user_name='tempest-TestMinimumBasicScenario-86254494-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:29:59Z,user_data=None,user_id='3a487c00935d4baa981cc8a1567af2a8',uuid=c34e2e7a-11a3-4718-9d67-f3eab7f21e4b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converting VIF {"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:3c,bridge_name='br-int',has_traffic_filtering=True,id=c887ac21-4c60-4ba5-8c1b-1fcfae69e385,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc887ac21-4c') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG os_vif [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:3c,bridge_name='br-int',has_traffic_filtering=True,id=c887ac21-4c60-4ba5-8c1b-1fcfae69e385,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc887ac21-4c') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '977a919b-c4b1-57b5-a9ee-64f74bffdacf', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc887ac21-4c, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc887ac21-4c, col_values=(('qos', UUID('e95e8604-9ced-4dfc-ae41-c62fda11554f')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc887ac21-4c, col_values=(('external_ids', {'iface-id': 'c887ac21-4c60-4ba5-8c1b-1fcfae69e385', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b9:84:3c', 'vm-uuid': 'c34e2e7a-11a3-4718-9d67-f3eab7f21e4b'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:01 user nova-compute[75102]: INFO os_vif [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b9:84:3c,bridge_name='br-int',has_traffic_filtering=True,id=c887ac21-4c60-4ba5-8c1b-1fcfae69e385,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc887ac21-4c')
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No VIF found with MAC fa:16:3e:b9:84:3c, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.network.neutron [req-c6ad21a2-8f22-47c8-95d7-37be2cdf9db4 req-bef30716-193c-45a8-aa09-249d23f9c3ab service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updated VIF entry in instance network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.network.neutron [req-c6ad21a2-8f22-47c8-95d7-37be2cdf9db4 req-bef30716-193c-45a8-aa09-249d23f9c3ab service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updating instance_info_cache with network_info: [{"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c6ad21a2-8f22-47c8-95d7-37be2cdf9db4 req-bef30716-193c-45a8-aa09-249d23f9c3ab service nova] Releasing lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:30:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-3f178109-535b-41c1-8962-0ca54296a0ff req-f1c83ac0-1a49-4cfc-abf8-6a0157ec2a3a service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3f178109-535b-41c1-8962-0ca54296a0ff req-f1c83ac0-1a49-4cfc-abf8-6a0157ec2a3a service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3f178109-535b-41c1-8962-0ca54296a0ff req-f1c83ac0-1a49-4cfc-abf8-6a0157ec2a3a service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3f178109-535b-41c1-8962-0ca54296a0ff req-f1c83ac0-1a49-4cfc-abf8-6a0157ec2a3a service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-3f178109-535b-41c1-8962-0ca54296a0ff req-f1c83ac0-1a49-4cfc-abf8-6a0157ec2a3a service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:30:03 user nova-compute[75102]: WARNING nova.compute.manager [req-3f178109-535b-41c1-8962-0ca54296a0ff req-f1c83ac0-1a49-4cfc-abf8-6a0157ec2a3a service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state building and task_state spawning.
Nov 10 16:30:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:30:03 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:30:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7610MB free_disk=24.99380874633789GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1d2937fc-16d6-4167-9b43-f0f44663deda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a437e642-d3a4-4356-805e-cb68da21167f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8475b9aa-13f8-4cf4-9636-743bee133121 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6c571e41-3f17-40f4-bcbc-4f3f86585d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.751s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.compute.manager [req-2e78904b-0e15-4697-ac96-e47e234c00fa req-6e63cd0f-6268-42cb-ad2d-495bb13a607b service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2e78904b-0e15-4697-ac96-e47e234c00fa req-6e63cd0f-6268-42cb-ad2d-495bb13a607b service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2e78904b-0e15-4697-ac96-e47e234c00fa req-6e63cd0f-6268-42cb-ad2d-495bb13a607b service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2e78904b-0e15-4697-ac96-e47e234c00fa req-6e63cd0f-6268-42cb-ad2d-495bb13a607b service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.compute.manager [req-2e78904b-0e15-4697-ac96-e47e234c00fa req-6e63cd0f-6268-42cb-ad2d-495bb13a607b service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:30:05 user nova-compute[75102]: WARNING nova.compute.manager [req-2e78904b-0e15-4697-ac96-e47e234c00fa req-6e63cd0f-6268-42cb-ad2d-495bb13a607b service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state building and task_state spawning.
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:30:05 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Instance spawned successfully.
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:30:05 user nova-compute[75102]: INFO nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Took 6.55 seconds to spawn the instance on the hypervisor.
Nov 10 16:30:05 user nova-compute[75102]: DEBUG nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:30:05 user nova-compute[75102]: INFO nova.compute.manager [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Took 7.65 seconds to build instance.
Nov 10 16:30:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-12ba3eef-ebcc-4c13-83ed-049782a855c9 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.805s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:06 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:30:06 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:30:06 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXDHLUbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:30:08 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:30:08 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:30:08 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9df9ce6f-45e9-4520-a5fb-79bbd1025b50]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:30:08 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[25ad086a-1045-4608-8eac-d758c06718cd]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea] added
Nov 10 16:30:08 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.043s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[87788dfe-c521-4885-8785-54690f4f48b3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c5750c-a3bc-4406-9a31-4f48617150f6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXDHLUbO {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pXDHLUbO" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8e9b40e-1b84-44e2-99f0-a4849b2f511d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pXDHLUbO'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf92e58-3865-4f84-bf4e-40f97db8ed2f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f4050fa-a407-482d-af38-3deb8c985031]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8968353f-863d-4a19-af80-215ac7fcbca4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea, portal: 172.16.0.220,3260]
Nov 10 16:30:08 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea, portal: 172.16.0.220,3260] successful.
Nov 10 16:30:08 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[03bd8cf8-c4ce-4667-9fc2-a120449de4c3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced7d51f-63a4-407d-acb8-7d26fd16db70]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)
Nov 10 16:30:08 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:08 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] HCTL ('38', '-', '-', 0) found on session 25 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a19b78-37c5-4c99-a1e9-86ed4e9502e7]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Searching for a device in session 25 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:30:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXDHLUbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:30:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.430s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:30:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23830323437613661', 'path': '/dev/sdg'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:30:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830323437613661', 'path': '/dev/sdg'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:30:09 user nova-compute[75102]: DEBUG nova.objects.instance [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'flavor' on Instance uuid 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:30:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:30:09 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:30:09 user nova-compute[75102]:   <source dev="/dev/sdg"/>
Nov 10 16:30:09 user nova-compute[75102]:   <target dev="vdc" bus="virtio"/>
Nov 10 16:30:09 user nova-compute[75102]:   <serial>8103a4ac-edc2-4754-9193-e411c51aa4ea</serial>
Nov 10 16:30:09 user nova-compute[75102]: </disk>
Nov 10 16:30:09 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:30:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:30:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:30:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:30:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] No VIF found with MAC fa:16:3e:d4:75:b3, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:30:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-02104fe9-cd3b-4490-9740-d4bc0bb0033f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.788s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:11 user nova-compute[75102]: INFO nova.compute.manager [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Detaching volume 382719ab-3240-420a-bde6-49e68ac50241
Nov 10 16:30:11 user nova-compute[75102]: INFO nova.virt.block_device [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Attempting to driver detach volume 382719ab-3240-420a-bde6-49e68ac50241 from mountpoint /dev/vdb
Nov 10 16:30:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Attempting to detach device vdb from instance 8475b9aa-13f8-4cf4-9636-743bee133121 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:30:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:30:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:30:11 user nova-compute[75102]:   <source dev="/dev/sdf"/>
Nov 10 16:30:11 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:30:11 user nova-compute[75102]:   <serial>382719ab-3240-420a-bde6-49e68ac50241</serial>
Nov 10 16:30:11 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:30:11 user nova-compute[75102]: </disk>
Nov 10 16:30:11 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:30:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Successfully detached device vdb from instance 8475b9aa-13f8-4cf4-9636-743bee133121 from the persistent domain config.
Nov 10 16:30:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8475b9aa-13f8-4cf4-9636-743bee133121 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:30:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:30:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:30:11 user nova-compute[75102]:   <source dev="/dev/sdf"/>
Nov 10 16:30:11 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:30:11 user nova-compute[75102]:   <serial>382719ab-3240-420a-bde6-49e68ac50241</serial>
Nov 10 16:30:11 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:30:11 user nova-compute[75102]: </disk>
Nov 10 16:30:11 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:30:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:30:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:21 user nova-compute[75102]: INFO nova.compute.manager [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Detaching volume fff14467-130d-43cf-a2ef-bb01708add8f
Nov 10 16:30:21 user nova-compute[75102]: INFO nova.virt.block_device [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Attempting to driver detach volume fff14467-130d-43cf-a2ef-bb01708add8f from mountpoint /dev/vdb
Nov 10 16:30:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Attempting to detach device vdb from instance a437e642-d3a4-4356-805e-cb68da21167f from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:30:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:30:21 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:30:21 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:30:21 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:30:21 user nova-compute[75102]:   <serial>fff14467-130d-43cf-a2ef-bb01708add8f</serial>
Nov 10 16:30:21 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:30:21 user nova-compute[75102]: </disk>
Nov 10 16:30:21 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:30:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully detached device vdb from instance a437e642-d3a4-4356-805e-cb68da21167f from the persistent domain config.
Nov 10 16:30:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a437e642-d3a4-4356-805e-cb68da21167f from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:30:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:30:21 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:30:21 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:30:21 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:30:21 user nova-compute[75102]:   <serial>fff14467-130d-43cf-a2ef-bb01708add8f</serial>
Nov 10 16:30:21 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:30:21 user nova-compute[75102]: </disk>
Nov 10 16:30:21 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:30:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a437e642-d3a4-4356-805e-cb68da21167f {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:30:24 user nova-compute[75102]: INFO nova.compute.manager [None req-d3a649a3-237e-45ce-b6e5-3add3dfc2434 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Unrescuing
Nov 10 16:30:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3a649a3-237e-45ce-b6e5-3add3dfc2434 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:30:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3a649a3-237e-45ce-b6e5-3add3dfc2434 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquired lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:30:24 user nova-compute[75102]: DEBUG nova.network.neutron [None req-d3a649a3-237e-45ce-b6e5-3add3dfc2434 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:30:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-d3a649a3-237e-45ce-b6e5-3add3dfc2434 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating instance_info_cache with network_info: [{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d3a649a3-237e-45ce-b6e5-3add3dfc2434 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Releasing lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d3a649a3-237e-45ce-b6e5-3add3dfc2434 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'flavor' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-6eb88f1b-00bf-42f1-87a9-0278bc884e99 req-0d09b5f4-3ba0-48e9-930d-9dfe1133bc41 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-unplugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6eb88f1b-00bf-42f1-87a9-0278bc884e99 req-0d09b5f4-3ba0-48e9-930d-9dfe1133bc41 service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6eb88f1b-00bf-42f1-87a9-0278bc884e99 req-0d09b5f4-3ba0-48e9-930d-9dfe1133bc41 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6eb88f1b-00bf-42f1-87a9-0278bc884e99 req-0d09b5f4-3ba0-48e9-930d-9dfe1133bc41 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-6eb88f1b-00bf-42f1-87a9-0278bc884e99 req-0d09b5f4-3ba0-48e9-930d-9dfe1133bc41 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-unplugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:30:25 user nova-compute[75102]: WARNING nova.compute.manager [req-6eb88f1b-00bf-42f1-87a9-0278bc884e99 req-0d09b5f4-3ba0-48e9-930d-9dfe1133bc41 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-unplugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:30:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-3066285f-2217-4ae0-87ad-55b7dd2f363b req-75fd7960-cf1e-41a2-82ca-13bc5cee5045 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-changed-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-3066285f-2217-4ae0-87ad-55b7dd2f363b req-75fd7960-cf1e-41a2-82ca-13bc5cee5045 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Refreshing instance network info cache due to event network-changed-717a43fb-d615-4290-806b-cfaa817bee6f. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:30:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3066285f-2217-4ae0-87ad-55b7dd2f363b req-75fd7960-cf1e-41a2-82ca-13bc5cee5045 service nova] Acquiring lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:30:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3066285f-2217-4ae0-87ad-55b7dd2f363b req-75fd7960-cf1e-41a2-82ca-13bc5cee5045 service nova] Acquired lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:30:26 user nova-compute[75102]: DEBUG nova.network.neutron [req-3066285f-2217-4ae0-87ad-55b7dd2f363b req-75fd7960-cf1e-41a2-82ca-13bc5cee5045 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Refreshing network info cache for port 717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:30:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Instance destroyed successfully.
Nov 10 16:30:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:26 user nova-compute[75102]: DEBUG nova.network.neutron [req-3066285f-2217-4ae0-87ad-55b7dd2f363b req-75fd7960-cf1e-41a2-82ca-13bc5cee5045 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updated VIF entry in instance network info cache for port 717a43fb-d615-4290-806b-cfaa817bee6f. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:30:26 user nova-compute[75102]: DEBUG nova.network.neutron [req-3066285f-2217-4ae0-87ad-55b7dd2f363b req-75fd7960-cf1e-41a2-82ca-13bc5cee5045 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating instance_info_cache with network_info: [{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:30:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3066285f-2217-4ae0-87ad-55b7dd2f363b req-75fd7960-cf1e-41a2-82ca-13bc5cee5045 service nova] Releasing lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:30:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:27 user nova-compute[75102]: DEBUG nova.compute.manager [req-6ada3055-1b5d-422a-9235-30623f34f67b req-f067eddc-1b5d-4742-80ae-97c0bf016fee service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6ada3055-1b5d-422a-9235-30623f34f67b req-f067eddc-1b5d-4742-80ae-97c0bf016fee service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6ada3055-1b5d-422a-9235-30623f34f67b req-f067eddc-1b5d-4742-80ae-97c0bf016fee service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6ada3055-1b5d-422a-9235-30623f34f67b req-f067eddc-1b5d-4742-80ae-97c0bf016fee service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:27 user nova-compute[75102]: DEBUG nova.compute.manager [req-6ada3055-1b5d-422a-9235-30623f34f67b req-f067eddc-1b5d-4742-80ae-97c0bf016fee service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:30:27 user nova-compute[75102]: WARNING nova.compute.manager [req-6ada3055-1b5d-422a-9235-30623f34f67b req-f067eddc-1b5d-4742-80ae-97c0bf016fee service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:30:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-45cbad02-5395-4f05-bc67-71e204b6a0ab req-f3319415-165f-4f6e-8803-90255a6bea30 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-changed-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-45cbad02-5395-4f05-bc67-71e204b6a0ab req-f3319415-165f-4f6e-8803-90255a6bea30 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Refreshing instance network info cache due to event network-changed-717a43fb-d615-4290-806b-cfaa817bee6f. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:30:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-45cbad02-5395-4f05-bc67-71e204b6a0ab req-f3319415-165f-4f6e-8803-90255a6bea30 service nova] Acquiring lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:30:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-45cbad02-5395-4f05-bc67-71e204b6a0ab req-f3319415-165f-4f6e-8803-90255a6bea30 service nova] Acquired lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:30:28 user nova-compute[75102]: DEBUG nova.network.neutron [req-45cbad02-5395-4f05-bc67-71e204b6a0ab req-f3319415-165f-4f6e-8803-90255a6bea30 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Refreshing network info cache for port 717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:30:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:28 user nova-compute[75102]: DEBUG nova.network.neutron [req-45cbad02-5395-4f05-bc67-71e204b6a0ab req-f3319415-165f-4f6e-8803-90255a6bea30 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updated VIF entry in instance network info cache for port 717a43fb-d615-4290-806b-cfaa817bee6f. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:30:28 user nova-compute[75102]: DEBUG nova.network.neutron [req-45cbad02-5395-4f05-bc67-71e204b6a0ab req-f3319415-165f-4f6e-8803-90255a6bea30 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating instance_info_cache with network_info: [{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:30:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-45cbad02-5395-4f05-bc67-71e204b6a0ab req-f3319415-165f-4f6e-8803-90255a6bea30 service nova] Releasing lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:30:29 user nova-compute[75102]: WARNING nova.compute.manager [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:30:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:30:29 user nova-compute[75102]: WARNING nova.compute.manager [req-90c1c7eb-3519-45c2-abbf-d89f084a9f9f req-83e3e4b8-0313-46f6-998a-8715705c24a0 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:30:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-d3a649a3-237e-45ce-b6e5-3add3dfc2434 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:31 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 8475b9aa-13f8-4cf4-9636-743bee133121 is timed out.
Nov 10 16:30:31 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Successfully detached device vdb from instance 8475b9aa-13f8-4cf4-9636-743bee133121 from the live domain config.
Nov 10 16:30:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DiJRAkex', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:30:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:30:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38213021-7e9e-42b1-ae7a-d20bb2d130c3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:30:31 user nova-compute[75102]: No targets found.
Nov 10 16:30:31 user nova-compute[75102]: iSNS:
Nov 10 16:30:31 user nova-compute[75102]: No targets found.
Nov 10 16:30:31 user nova-compute[75102]: STATIC:
Nov 10 16:30:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f
Nov 10 16:30:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62
Nov 10 16:30:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241
Nov 10 16:30:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0
Nov 10 16:30:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:30:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea
Nov 10 16:30:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:31 user nova-compute[75102]: FIRMWARE:
Nov 10 16:30:31 user nova-compute[75102]: No targets found.
Nov 10 16:30:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:30:31 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:30:31 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:30:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a106ca-be7a-4576-bd16-3016fa26b5a4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb6b73a-2f06-4c27-bb5c-8c829c20848e]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)
Nov 10 16:30:32 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74607520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241'): ({'sdf'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Removing single pathed devices sdf {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbc94ae-c27f-467c-aa7f-7cd59af2f114]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca758ac-4656-4638-92b9-3e47233378ea]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Flushing IO for device /dev/sdf {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[17353cd4-96e0-4ba8-82ca-477357675359]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9f88da2-1dcf-4658-9bb6-99ea268979c9]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] SCSI volumes sdf have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36338ee-068a-46c1-8d98-1d49bdb863ab]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0969a7d-c10d-4a4f-a6b6-d8e4c83699e6]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241, portal: 172.16.0.220,3260]
Nov 10 16:30:32 user nova-compute[75102]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241, portal: 172.16.0.220,3260] successful.
Nov 10 16:30:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:382719ab-3240-420a-bde6-49e68ac50241 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[24488240-98df-4ad8-b760-b11e2f337869]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] <== disconnect_volume: return (341ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:30:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:30:33 user nova-compute[75102]: DEBUG nova.objects.instance [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'flavor' on Instance uuid 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:30:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b39b541a-dfac-4ea6-939a-f7101fc72c40 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.152s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:34 user nova-compute[75102]: INFO nova.compute.manager [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Detaching volume 8103a4ac-edc2-4754-9193-e411c51aa4ea
Nov 10 16:30:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:34 user nova-compute[75102]: INFO nova.virt.block_device [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Attempting to driver detach volume 8103a4ac-edc2-4754-9193-e411c51aa4ea from mountpoint /dev/vdc
Nov 10 16:30:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Attempting to detach device vdc from instance 8475b9aa-13f8-4cf4-9636-743bee133121 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:30:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:30:34 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:30:34 user nova-compute[75102]:   <source dev="/dev/sdg"/>
Nov 10 16:30:34 user nova-compute[75102]:   <target dev="vdc" bus="virtio"/>
Nov 10 16:30:34 user nova-compute[75102]:   <serial>8103a4ac-edc2-4754-9193-e411c51aa4ea</serial>
Nov 10 16:30:34 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 16:30:34 user nova-compute[75102]: </disk>
Nov 10 16:30:34 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:30:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Successfully detached device vdc from instance 8475b9aa-13f8-4cf4-9636-743bee133121 from the persistent domain config.
Nov 10 16:30:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8475b9aa-13f8-4cf4-9636-743bee133121 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:30:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:30:34 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:30:34 user nova-compute[75102]:   <source dev="/dev/sdg"/>
Nov 10 16:30:34 user nova-compute[75102]:   <target dev="vdc" bus="virtio"/>
Nov 10 16:30:34 user nova-compute[75102]:   <serial>8103a4ac-edc2-4754-9193-e411c51aa4ea</serial>
Nov 10 16:30:34 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 16:30:34 user nova-compute[75102]: </disk>
Nov 10 16:30:34 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:30:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:30:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:41 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a437e642-d3a4-4356-805e-cb68da21167f is timed out.
Nov 10 16:30:41 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully detached device vdb from instance a437e642-d3a4-4356-805e-cb68da21167f from the live domain config.
Nov 10 16:30:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'nQdahjWJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:30:41 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3837cd-ac7e-480e-9f49-35808f1d092c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:30:41 user nova-compute[75102]: No targets found.
Nov 10 16:30:41 user nova-compute[75102]: iSNS:
Nov 10 16:30:41 user nova-compute[75102]: No targets found.
Nov 10 16:30:41 user nova-compute[75102]: STATIC:
Nov 10 16:30:41 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f
Nov 10 16:30:41 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:41 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:41 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62
Nov 10 16:30:41 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:41 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:41 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0
Nov 10 16:30:41 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:41 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:41 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:30:41 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:41 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:41 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea
Nov 10 16:30:41 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:41 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:41 user nova-compute[75102]: FIRMWARE:
Nov 10 16:30:41 user nova-compute[75102]: No targets found.
Nov 10 16:30:41 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:30:41 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:30:41 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3653997f-503f-4b26-b1c0-2b4736e72976]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3612f42-3143-4d5c-8aa5-9b354f0fe09c]: (4, ('tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:30:41 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:41 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:41 user nova-compute[75102]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)
Nov 10 16:30:41 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:41 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsi session list stdout=tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f (non-flash)
Nov 10 16:30:41 user nova-compute[75102]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:41 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:41 user nova-compute[75102]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)
Nov 10 16:30:41 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:41 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74476830>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a76dc6-4fc6-44ba-9384-6e75a39d27c9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f71225f-b696-400e-9ccc-a4da84a9cba7]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1eee738-5b7b-461f-ab21-60735ed92b52]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3312dc73-ed4e-4c35-983e-9141963043fe]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea89253e-9598-4310-bc67-835ecd77e1ab]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85f64cb-c08e-4590-8798-70ddb0896c5f]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f, portal: 172.16.0.220,3260]
Nov 10 16:30:42 user nova-compute[75102]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f, portal: 172.16.0.220,3260] successful.
Nov 10 16:30:42 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fff14467-130d-43cf-a2ef-bb01708add8f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3feff2a3-5aed-4fab-9172-c6a3f1eb54f3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] <== disconnect_volume: return (368ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:30:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:30:43 user nova-compute[75102]: DEBUG nova.objects.instance [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'flavor' on Instance uuid a437e642-d3a4-4356-805e-cb68da21167f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:30:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-04f73bb6-9c10-4c2c-a648-9e0a5047e76d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.173s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-e6543980-eae3-41c1-9b78-ce8ff38b1587 req-8df3a570-f6ae-4e75-b532-4833d41e1be4 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-changed-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-e6543980-eae3-41c1-9b78-ce8ff38b1587 req-8df3a570-f6ae-4e75-b532-4833d41e1be4 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Refreshing instance network info cache due to event network-changed-463f7077-f0c7-4f09-b53b-6d374ec16fa2. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:30:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e6543980-eae3-41c1-9b78-ce8ff38b1587 req-8df3a570-f6ae-4e75-b532-4833d41e1be4 service nova] Acquiring lock "refresh_cache-22865b86-3ce3-4ec7-89c4-fc08684a0a60" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:30:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e6543980-eae3-41c1-9b78-ce8ff38b1587 req-8df3a570-f6ae-4e75-b532-4833d41e1be4 service nova] Acquired lock "refresh_cache-22865b86-3ce3-4ec7-89c4-fc08684a0a60" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:30:43 user nova-compute[75102]: DEBUG nova.network.neutron [req-e6543980-eae3-41c1-9b78-ce8ff38b1587 req-8df3a570-f6ae-4e75-b532-4833d41e1be4 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Refreshing network info cache for port 463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-e6543980-eae3-41c1-9b78-ce8ff38b1587 req-8df3a570-f6ae-4e75-b532-4833d41e1be4 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Updated VIF entry in instance network info cache for port 463f7077-f0c7-4f09-b53b-6d374ec16fa2. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-e6543980-eae3-41c1-9b78-ce8ff38b1587 req-8df3a570-f6ae-4e75-b532-4833d41e1be4 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Updating instance_info_cache with network_info: [{"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e6543980-eae3-41c1-9b78-ce8ff38b1587 req-8df3a570-f6ae-4e75-b532-4833d41e1be4 service nova] Releasing lock "refresh_cache-22865b86-3ce3-4ec7-89c4-fc08684a0a60" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'flavor' on Instance uuid 22865b86-3ce3-4ec7-89c4-fc08684a0a60 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:44 user nova-compute[75102]: INFO nova.compute.manager [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Attaching volume eec57ecc-343d-493d-8d69-2a8f3752e72d to /dev/vdb
Nov 10 16:30:44 user nova-compute[75102]: DEBUG os_brick.utils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[668c2c17-a47a-4ac3-ab4f-fd2b841ffb60]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a87160-34cc-49c6-a81f-e379e8d75887]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[54bdce14-fa72-4457-8ccc-aadc0a46de9b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dedbe30-cd51-4db9-be6a-47fcb1247857]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:30:44 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:30:44 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[92017ea0-36b4-4ddb-85f0-3fc6fdee03f5]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG os_brick.utils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:30:44 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Updating existing volume attachment record: 4cd8c5a6-ab48-473e-ac83-37eb5ae59f91 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:30:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:55 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 8475b9aa-13f8-4cf4-9636-743bee133121 is timed out.
Nov 10 16:30:55 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Successfully detached device vdc from instance 8475b9aa-13f8-4cf4-9636-743bee133121 from the live domain config.
Nov 10 16:30:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pXDHLUbO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:30:55 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9f40d5-8ea8-4cf8-91a2-a201cd7ad238]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a123f2d3-17de-46de-bfa3-5ae394f99c74\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:30:55 user nova-compute[75102]: No targets found.
Nov 10 16:30:55 user nova-compute[75102]: iSNS:
Nov 10 16:30:55 user nova-compute[75102]: No targets found.
Nov 10 16:30:55 user nova-compute[75102]: STATIC:
Nov 10 16:30:55 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62
Nov 10 16:30:55 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:55 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:55 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0
Nov 10 16:30:55 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:55 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:55 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:30:55 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:55 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:55 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea
Nov 10 16:30:55 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:55 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:55 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:a123f2d3-17de-46de-bfa3-5ae394f99c74
Nov 10 16:30:55 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:30:55 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:30:55 user nova-compute[75102]: FIRMWARE:
Nov 10 16:30:55 user nova-compute[75102]: No targets found.
Nov 10 16:30:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:30:55 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:30:55 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fe3d017-a3fc-4fd0-838f-3e11acc1f410]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a123f2d3-17de-46de-bfa3-5ae394f99c74\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[27c2284b-d928-4be4-83d1-7215dae05eeb]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a123f2d3-17de-46de-bfa3-5ae394f99c74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:55 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:55 user nova-compute[75102]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)
Nov 10 16:30:55 user nova-compute[75102]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a123f2d3-17de-46de-bfa3-5ae394f99c74 (non-flash)
Nov 10 16:30:55 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:30:55 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:30:55 user nova-compute[75102]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea (non-flash)
Nov 10 16:30:55 user nova-compute[75102]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a123f2d3-17de-46de-bfa3-5ae394f99c74 (non-flash)
Nov 10 16:30:55 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:30:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f746045e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea'): ({'sdg'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Removing single pathed devices sdg {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a790b65a-dda6-4633-a155-89822d4020da]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72109fb-5ad4-493d-a241-ea063b83d137]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Flushing IO for device /dev/sdg {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[21310d3f-3c22-4188-b6cc-c0f48e08f191]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.050s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7708bf-f398-47c8-98ab-0c8dfa89e95c]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] SCSI volumes sdg have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc64d76b-7c96-4dc5-bebb-9a38fcc8f36f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05a696b-f3aa-4829-a36e-90cee6666a38]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea, portal: 172.16.0.220,3260]
Nov 10 16:30:55 user nova-compute[75102]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea, portal: 172.16.0.220,3260] successful.
Nov 10 16:30:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8103a4ac-edc2-4754-9193-e411c51aa4ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[56bfc370-16db-4c9e-8cb2-5d4519835fc1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] <== disconnect_volume: return (393ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:30:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:30:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:56 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:30:56 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:30:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:57 user nova-compute[75102]: DEBUG nova.objects.instance [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'flavor' on Instance uuid 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:30:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:30:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b0d203ae-142e-42ac-a909-45bccb5203a8 tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.951s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:30:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:58 user nova-compute[75102]: INFO nova.compute.manager [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Detaching volume 856178a7-34e8-488b-9157-1068f28b5eb0
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:59 user nova-compute[75102]: INFO nova.compute.manager [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Terminating instance
Nov 10 16:30:59 user nova-compute[75102]: DEBUG nova.compute.manager [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:30:59 user nova-compute[75102]: INFO nova.virt.block_device [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Attempting to driver detach volume 856178a7-34e8-488b-9157-1068f28b5eb0 from mountpoint /dev/vdb
Nov 10 16:30:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Attempting to detach device vdb from instance 1d2937fc-16d6-4167-9b43-f0f44663deda from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:30:59 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:30:59 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:30:59 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:30:59 user nova-compute[75102]:   <serial>856178a7-34e8-488b-9157-1068f28b5eb0</serial>
Nov 10 16:30:59 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:30:59 user nova-compute[75102]: </disk>
Nov 10 16:30:59 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:59 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Successfully detached device vdb from instance 1d2937fc-16d6-4167-9b43-f0f44663deda from the persistent domain config.
Nov 10 16:30:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1d2937fc-16d6-4167-9b43-f0f44663deda from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:30:59 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:30:59 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:30:59 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:30:59 user nova-compute[75102]:   <serial>856178a7-34e8-488b-9157-1068f28b5eb0</serial>
Nov 10 16:30:59 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:30:59 user nova-compute[75102]: </disk>
Nov 10 16:30:59 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-a4a82cc6-bf1c-4086-bacf-11ed1700670c req-348b46d8-fab6-43cd-83b8-c27d4290149d service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received event network-vif-unplugged-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a4a82cc6-bf1c-4086-bacf-11ed1700670c req-348b46d8-fab6-43cd-83b8-c27d4290149d service nova] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a4a82cc6-bf1c-4086-bacf-11ed1700670c req-348b46d8-fab6-43cd-83b8-c27d4290149d service nova] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a4a82cc6-bf1c-4086-bacf-11ed1700670c req-348b46d8-fab6-43cd-83b8-c27d4290149d service nova] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-a4a82cc6-bf1c-4086-bacf-11ed1700670c req-348b46d8-fab6-43cd-83b8-c27d4290149d service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] No waiting events found dispatching network-vif-unplugged-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:30:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-a4a82cc6-bf1c-4086-bacf-11ed1700670c req-348b46d8-fab6-43cd-83b8-c27d4290149d service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received event network-vif-unplugged-68b9de94-fc76-474f-9d06-cd6552434dec for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:31:00 user nova-compute[75102]: INFO nova.compute.manager [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Rescuing
Nov 10 16:31:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquired lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:31:00 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Instance destroyed successfully.
Nov 10 16:31:00 user nova-compute[75102]: DEBUG nova.objects.instance [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lazy-loading 'resources' on Instance uuid 8475b9aa-13f8-4cf4-9636-743bee133121 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:26:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1261702710',display_name='tempest-AttachVolumeTestJSON-server-1261702710',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1261702710',id=23,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMZJ1wBHsihPr/s+rlNAv+zFEgK766MQ+rn3qAd7rK50j2eVhQjzn/GyKRo3rAHUUIwXLktEKEpq1iLnuE94h45Cl31fdZrZ/zqVri/zL3HXHlX3LSl3EmPCkbDHTspg1w==',key_name='tempest-keypair-1119004403',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:26:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d6d408293bc34453b58b852baca77d35',ramdisk_id='',reservation_id='r-nh9h8vkr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-1946940767',owner_user_name='tempest-AttachVolumeTestJSON-1946940767-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:26:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='95ef5e9028c34d61b880bff813a53216',uuid=8475b9aa-13f8-4cf4-9636-743bee133121,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converting VIF {"id": "68b9de94-fc76-474f-9d06-cd6552434dec", "address": "fa:16:3e:d4:75:b3", "network": {"id": "283689df-3b06-4170-bd45-75ee122b793f", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1943310138-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.229", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d6d408293bc34453b58b852baca77d35", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap68b9de94-fc", "ovs_interfaceid": "68b9de94-fc76-474f-9d06-cd6552434dec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d4:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=68b9de94-fc76-474f-9d06-cd6552434dec,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b9de94-fc') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG os_vif [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=68b9de94-fc76-474f-9d06-cd6552434dec,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b9de94-fc') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap68b9de94-fc, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f6d85b1-bc48-4b53-8996-6e10b0098cc3) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:00 user nova-compute[75102]: INFO os_vif [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d4:75:b3,bridge_name='br-int',has_traffic_filtering=True,id=68b9de94-fc76-474f-9d06-cd6552434dec,network=Network(283689df-3b06-4170-bd45-75ee122b793f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap68b9de94-fc')
Nov 10 16:31:00 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Deleting instance files /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121_del
Nov 10 16:31:00 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Deletion of /opt/stack/data/nova/instances/8475b9aa-13f8-4cf4-9636-743bee133121_del complete
Nov 10 16:31:00 user nova-compute[75102]: INFO nova.compute.manager [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Took 1.72 seconds to destroy the instance on the hypervisor.
Nov 10 16:31:00 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Updating instance_info_cache with network_info: [{"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Releasing lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.294s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG nova.compute.manager [req-82fb007e-a3cb-4c2b-821c-a5b101a09bd5 req-a9fca9f0-3067-4611-9670-4102424cbbfb service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received event network-vif-deleted-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:01 user nova-compute[75102]: INFO nova.compute.manager [req-82fb007e-a3cb-4c2b-821c-a5b101a09bd5 req-a9fca9f0-3067-4611-9670-4102424cbbfb service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Neutron deleted interface 68b9de94-fc76-474f-9d06-cd6552434dec; detaching it from the instance and deleting it from the info cache
Nov 10 16:31:01 user nova-compute[75102]: DEBUG nova.network.neutron [req-82fb007e-a3cb-4c2b-821c-a5b101a09bd5 req-a9fca9f0-3067-4611-9670-4102424cbbfb service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:31:01 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Took 1.08 seconds to deallocate network for instance.
Nov 10 16:31:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:01 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Instance destroyed successfully.
Nov 10 16:31:01 user nova-compute[75102]: DEBUG nova.compute.manager [req-82fb007e-a3cb-4c2b-821c-a5b101a09bd5 req-a9fca9f0-3067-4611-9670-4102424cbbfb service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Detach interface failed, port_id=68b9de94-fc76-474f-9d06-cd6552434dec, reason: Instance 8475b9aa-13f8-4cf4-9636-743bee133121 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:31:01 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Attempting a stable device rescue
Nov 10 16:31:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75102) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received event network-vif-plugged-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] Acquiring lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] Lock "8475b9aa-13f8-4cf4-9636-743bee133121-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] No waiting events found dispatching network-vif-plugged-68b9de94-fc76-474f-9d06-cd6552434dec {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:02 user nova-compute[75102]: WARNING nova.compute.manager [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] [instance: 8475b9aa-13f8-4cf4-9636-743bee133121] Received unexpected event network-vif-plugged-68b9de94-fc76-474f-9d06-cd6552434dec for instance with vm_state deleted and task_state None.
Nov 10 16:31:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-unplugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-unplugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:02 user nova-compute[75102]: WARNING nova.compute.manager [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-unplugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state active and task_state rescuing.
Nov 10 16:31:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:02 user nova-compute[75102]: WARNING nova.compute.manager [req-172a6135-26fc-4214-aaa7-9288f45ebcb0 req-98476ac4-bbbc-4cf9-b7cf-e0fead0f6484 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state active and task_state rescuing.
Nov 10 16:31:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Instance directory exists: not creating {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 16:31:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Creating image(s)
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "/opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "/opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "/opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2.part --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 1.049s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquiring lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2.part --force-share --output=json" returned: 0 in 0.425s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG nova.virt.images [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] 3faa5be2-0bd0-48a3-aabf-cb2b2e3f6a84 was qcow2, converting to raw {{(pid=75102) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2.part /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2.converted {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:31:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.295s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.402s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.701s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.197s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:31:04 user nova-compute[75102]: INFO nova.compute.claims [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Claim successful on node user
Nov 10 16:31:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.361s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:05 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Deleted allocations for instance 8475b9aa-13f8-4cf4-9636-743bee133121
Nov 10 16:31:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.298s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-974dcc77-07fc-49e8-9ce3-39e36fb1482f tempest-AttachVolumeTestJSON-1946940767 tempest-AttachVolumeTestJSON-1946940767-project-member] Lock "8475b9aa-13f8-4cf4-9636-743bee133121" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 6.703s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.662s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:06 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:31:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:31:06 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Error from libvirt while getting description of instance-00000017: [Error Code 42] Domain not found: no domain with matching uuid '8475b9aa-13f8-4cf4-9636-743bee133121' (instance-00000017): libvirt.libvirtError: Domain not found: no domain with matching uuid '8475b9aa-13f8-4cf4-9636-743bee133121' (instance-00000017)
Nov 10 16:31:06 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:31:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2.part /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2.converted" returned: 0 in 3.088s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2.converted --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.678s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2.converted --force-share --output=json" returned: 0 in 0.561s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 5.218s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:31:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7663MB free_disk=24.390228271484375GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:31:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1d2937fc-16d6-4167-9b43-f0f44663deda actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance a437e642-d3a4-4356-805e-cb68da21167f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.policy [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0a9eddb7927d4fa2bfd2cce4f2697753', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2985007d7c04c68880c89199595e184', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2 --force-share --output=json" returned: 0 in 0.279s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2,backing_fmt=raw /opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.rescue {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6c571e41-3f17-40f4-bcbc-4f3f86585d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ec4a2e9d-de37-4e9b-840f-9c112f1b0789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:31:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Creating image(s)
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquiring lock "/opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "/opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "/opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2,backing_fmt=raw /opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.rescue" returned: 0 in 0.093s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.377s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'migration_context' on Instance uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<6c571e41-3f17-40f4-bcbc-4f3f86585d3f> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Start _get_guest_xml network_info=[{"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "vif_mac": "fa:16:3e:b1:9e:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3faa5be2-0bd0-48a3-aabf-cb2b2e3f6a84', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '7bb91a95-b74a-46d3-9f9f-a2958b36d3e2', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsxEXbNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '6c571e41-3f17-40f4-bcbc-4f3f86585d3f', 'attached_at': '', 'detached_at': '', 'volume_id': 'daf0210e-15d3-4819-adb4-77d798e1bf62', 'serial': 'daf0210e-15d3-4819-adb4-77d798e1bf62'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'resources' on Instance uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<6c571e41-3f17-40f4-bcbc-4f3f86585d3f> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'numa_topology' on Instance uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<6c571e41-3f17-40f4-bcbc-4f3f86585d3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:31:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:31:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<6c571e41-3f17-40f4-bcbc-4f3f86585d3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsxEXbNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:31:08 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:31:08 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:31:08 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.260s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260" returned: 0 in 0.043s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[139a8c67-4fb4-499f-8a53-19638f216d78]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = ZsxEXbNA\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 10 16:31:08 user nova-compute[75102]: node.name = iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62
Nov 10 16:31:08 user nova-compute[75102]: node.tpgt = -1
Nov 10 16:31:08 user nova-compute[75102]: node.startup = automatic
Nov 10 16:31:08 user nova-compute[75102]: node.leading_login = No
Nov 10 16:31:08 user nova-compute[75102]: iface.iscsi_ifacename = default
Nov 10 16:31:08 user nova-compute[75102]: iface.net_ifacename = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.ipaddress = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.prefix_len = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.hwaddress = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.transport_name = tcp
Nov 10 16:31:08 user nova-compute[75102]: iface.initiatorname = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.state = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.vlan_id = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.vlan_priority = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.vlan_state = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.iface_num = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.mtu = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.port = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.bootproto = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.subnet_mask = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.gateway = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.dhcp_alt_client_id_state = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.dhcp_alt_client_id = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.dhcp_dns = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.dhcp_learn_iqn = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.dhcp_req_vendor_id_state = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.dhcp_vendor_id_state = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.dhcp_vendor_id = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.dhcp_slp_da = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.fragmentation = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.gratuitous_arp = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.incoming_forwarding = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.tos_state = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.tos = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.ttl = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.delayed_ack = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.tcp_nagle = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.tcp_wsf_state = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.tcp_wsf = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.tcp_timer_scale = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.tcp_timestamp = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.redirect = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.def_task_mgmt_timeout = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.header_digest = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.data_digest = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.immediate_data = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.initial_r2t = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.data_seq_inorder = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.data_pdu_inorder = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.erl = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.max_receive_data_len = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.first_burst_len = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.max_outstanding_r2t = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.max_burst_len = 0
Nov 10 16:31:08 user nova-compute[75102]: iface.chap_auth = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.bidi_chap = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.strict_login_compliance = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.discovery_auth = <empty>
Nov 10 16:31:08 user nova-compute[75102]: iface.discovery_logout = <empty>
Nov 10 16:31:08 user nova-compute[75102]: node.discovery_address = <empty>
Nov 10 16:31:08 user nova-compute[75102]: node.discovery_port = 0
Nov 10 16:31:08 user nova-compute[75102]: node.discovery_type = static
Nov 10 16:31:08 user nova-compute[75102]: node.session.initial_cmdsn = 0
Nov 10 16:31:08 user nova-compute[75102]: node.session.initial_login_retry_max = 8
Nov 10 16:31:08 user nova-compute[75102]: node.session.xmit_thread_priority = -20
Nov 10 16:31:08 user nova-compute[75102]: node.session.cmds_max = 128
Nov 10 16:31:08 user nova-compute[75102]: node.session.queue_depth = 32
Nov 10 16:31:08 user nova-compute[75102]: node.session.nr_sessions = 1
Nov 10 16:31:08 user nova-compute[75102]: node.session.auth.authmethod = CHAP
Nov 10 16:31:08 user nova-compute[75102]: node.session.auth.username = ZsxEXbNA
Nov 10 16:31:08 user nova-compute[75102]: node.session.auth.password = ***
Nov 10 16:31:08 user nova-compute[75102]: node.session.auth.username_in = <empty>
Nov 10 16:31:08 user nova-compute[75102]: node.session.auth.password_in = <empty>
Nov 10 16:31:08 user nova-compute[75102]: node.session.auth.chap_algs = MD5
Nov 10 16:31:08 user nova-compute[75102]: node.session.timeo.replacement_timeout = 120
Nov 10 16:31:08 user nova-compute[75102]: node.session.err_timeo.abort_timeout = 15
Nov 10 16:31:08 user nova-compute[75102]: node.session.err_timeo.lu_reset_timeout = 30
Nov 10 16:31:08 user nova-compute[75102]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 10 16:31:08 user nova-compute[75102]: node.session.err_timeo.host_reset_timeout = 60
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.FastAbort = Yes
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.InitialR2T = No
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.ImmediateData = Yes
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.FirstBurstLength = 262144
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.MaxBurstLength = 16776192
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.DefaultTime2Retain = 0
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.DefaultTime2Wait = 2
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.MaxConnections = 1
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 10 16:31:08 user nova-compute[75102]: node.session.iscsi.ERL = 0
Nov 10 16:31:08 user nova-compute[75102]: node.session.scan = manual
Nov 10 16:31:08 user nova-compute[75102]: node.session.reopen_max = 0
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].address = 172.16.0.220
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].port = 3260
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].startup = manual
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].tcp.window_size = 524288
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].tcp.type_of_service = 0
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].timeo.logout_timeout = 15
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].timeo.login_timeout = 15
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].timeo.auth_timeout = 45
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].timeo.noop_out_interval = 5
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].timeo.noop_out_timeout = 5
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].iscsi.HeaderDigest = None
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].iscsi.DataDigest = None
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].iscsi.IFMarker = No
Nov 10 16:31:08 user nova-compute[75102]: node.conn[0].iscsi.OFMarker = No
Nov 10 16:31:08 user nova-compute[75102]: # END RECORD
Nov 10 16:31:08 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[de169ad5-8cbc-44ec-b83d-421296ea7c8a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.041s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[174da055-981d-478f-8859-e47187c9c369]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsxEXbNA {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ZsxEXbNA" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e286fd0-b231-4851-8050-5dadfa06b1d6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ZsxEXbNA'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.216s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.033s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6da4857-2756-4da1-a3a9-0a70b3989d34]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk 1073741824" returned: 0 in 0.073s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.294s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e570663-3efe-4097-b98b-9b4f287703a5]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a123f2d3-17de-46de-bfa3-5ae394f99c74 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:08 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:08 user nova-compute[75102]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a123f2d3-17de-46de-bfa3-5ae394f99c74 (non-flash)
Nov 10 16:31:08 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:08 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:08 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:08 user nova-compute[75102]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a123f2d3-17de-46de-bfa3-5ae394f99c74 (non-flash)
Nov 10 16:31:08 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:08 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.367s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] HCTL ('36', '0', '0', 0) found on session 23 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[56299294-3931-4f89-bdcb-04c4579935c4]: (4, ('0 0 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Searching for a device in session 23 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsxEXbNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.407s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] <== connect_volume: return (409ms) {'type': 'block', 'scsi_wwn': '23739666364313833', 'path': '/dev/sde'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739666364313833', 'path': '/dev/sde'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-489219966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-489219966',id=27,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:29:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-8idszope',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:29:15Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=6c571e41-3f17-40f4-bcbc-4f3f86585d3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "vif_mac": "fa:16:3e:b1:9e:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "vif_mac": "fa:16:3e:b1:9e:05"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:05,bridge_name='br-int',has_traffic_filtering=True,id=728d5a24-aa97-4f3f-b8b0-3436cdb1d100,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d5a24-aa') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.objects.instance [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'pci_devices' on Instance uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Successfully created port: 91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.066s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.objects.base [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Object Instance<6c571e41-3f17-40f4-bcbc-4f3f86585d3f> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:31:08 user nova-compute[75102]:   <uuid>6c571e41-3f17-40f4-bcbc-4f3f86585d3f</uuid>
Nov 10 16:31:08 user nova-compute[75102]:   <name>instance-0000001b</name>
Nov 10 16:31:08 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:31:08 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:31:08 user nova-compute[75102]:   <metadata>
Nov 10 16:31:08 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:31:08 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:31:08 user nova-compute[75102]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-489219966</nova:name>
Nov 10 16:31:08 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:31:07</nova:creationTime>
Nov 10 16:31:08 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:31:08 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:31:08 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:31:08 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:31:08 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:31:08 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:31:08 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:31:08 user nova-compute[75102]:       <nova:owner>
Nov 10 16:31:08 user nova-compute[75102]:         <nova:user uuid="3149d0620bf64829aa4eec99a2cddee5">tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member</nova:user>
Nov 10 16:31:08 user nova-compute[75102]:         <nova:project uuid="c0e926f56f914e7488a50f5bb78a33cd">tempest-ServerBootFromVolumeStableRescueTest-918868864</nova:project>
Nov 10 16:31:08 user nova-compute[75102]:       </nova:owner>
Nov 10 16:31:08 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:31:08 user nova-compute[75102]:       <nova:ports>
Nov 10 16:31:08 user nova-compute[75102]:         <nova:port uuid="728d5a24-aa97-4f3f-b8b0-3436cdb1d100">
Nov 10 16:31:08 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:31:08 user nova-compute[75102]:         </nova:port>
Nov 10 16:31:08 user nova-compute[75102]:       </nova:ports>
Nov 10 16:31:08 user nova-compute[75102]:     </nova:instance>
Nov 10 16:31:08 user nova-compute[75102]:   </metadata>
Nov 10 16:31:08 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:31:08 user nova-compute[75102]:     <system>
Nov 10 16:31:08 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:31:08 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:31:08 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:31:08 user nova-compute[75102]:       <entry name="serial">6c571e41-3f17-40f4-bcbc-4f3f86585d3f</entry>
Nov 10 16:31:08 user nova-compute[75102]:       <entry name="uuid">6c571e41-3f17-40f4-bcbc-4f3f86585d3f</entry>
Nov 10 16:31:08 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:31:08 user nova-compute[75102]:     </system>
Nov 10 16:31:08 user nova-compute[75102]:   </sysinfo>
Nov 10 16:31:08 user nova-compute[75102]:   <os>
Nov 10 16:31:08 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:31:08 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:31:08 user nova-compute[75102]:   </os>
Nov 10 16:31:08 user nova-compute[75102]:   <features>
Nov 10 16:31:08 user nova-compute[75102]:     <acpi/>
Nov 10 16:31:08 user nova-compute[75102]:     <apic/>
Nov 10 16:31:08 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:31:08 user nova-compute[75102]:   </features>
Nov 10 16:31:08 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:31:08 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:31:08 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:31:08 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:31:08 user nova-compute[75102]:   </clock>
Nov 10 16:31:08 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:31:08 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:31:08 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:31:08 user nova-compute[75102]:   </cpu>
Nov 10 16:31:08 user nova-compute[75102]:   <devices>
Nov 10 16:31:08 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:31:08 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:31:08 user nova-compute[75102]:       <source dev="/dev/sde"/>
Nov 10 16:31:08 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:31:08 user nova-compute[75102]:       <serial>daf0210e-15d3-4819-adb4-77d798e1bf62</serial>
Nov 10 16:31:08 user nova-compute[75102]:     </disk>
Nov 10 16:31:08 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:31:08 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:31:08 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.rescue"/>
Nov 10 16:31:08 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:31:08 user nova-compute[75102]:       <boot order="1"/>
Nov 10 16:31:08 user nova-compute[75102]:     </disk>
Nov 10 16:31:08 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:31:08 user nova-compute[75102]:       <mac address="fa:16:3e:b1:9e:05"/>
Nov 10 16:31:08 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:31:08 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:31:08 user nova-compute[75102]:       <target dev="tap728d5a24-aa"/>
Nov 10 16:31:08 user nova-compute[75102]:     </interface>
Nov 10 16:31:08 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:31:08 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/console.log" append="off"/>
Nov 10 16:31:08 user nova-compute[75102]:     </serial>
Nov 10 16:31:08 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:31:08 user nova-compute[75102]:     <video>
Nov 10 16:31:08 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:31:08 user nova-compute[75102]:     </video>
Nov 10 16:31:08 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:31:08 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:31:08 user nova-compute[75102]:     </rng>
Nov 10 16:31:08 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:31:08 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:31:08 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:31:08 user nova-compute[75102]:     </memballoon>
Nov 10 16:31:08 user nova-compute[75102]:   </devices>
Nov 10 16:31:08 user nova-compute[75102]: </domain>
Nov 10 16:31:08 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:31:08 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Instance destroyed successfully.
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.248s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] No VIF found with MAC fa:16:3e:b1:9e:05, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json" returned: 0 in 0.300s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Cannot resize image /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Ensure instance console log exists: /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Successfully updated port: 91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquiring lock "refresh_cache-ec4a2e9d-de37-4e9b-840f-9c112f1b0789" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquired lock "refresh_cache-ec4a2e9d-de37-4e9b-840f-9c112f1b0789" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-2a40ee08-4337-4ebe-b4ea-a985b494f862 req-da013d49-e27a-470c-b168-acc78c1b1110 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received event network-changed-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-2a40ee08-4337-4ebe-b4ea-a985b494f862 req-da013d49-e27a-470c-b168-acc78c1b1110 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Refreshing instance network info cache due to event network-changed-91197a85-92dc-43d1-b9dc-3e8c37e583fe. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2a40ee08-4337-4ebe-b4ea-a985b494f862 req-da013d49-e27a-470c-b168-acc78c1b1110 service nova] Acquiring lock "refresh_cache-ec4a2e9d-de37-4e9b-840f-9c112f1b0789" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Updating instance_info_cache with network_info: [{"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Releasing lock "refresh_cache-ec4a2e9d-de37-4e9b-840f-9c112f1b0789" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Instance network_info: |[{"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2a40ee08-4337-4ebe-b4ea-a985b494f862 req-da013d49-e27a-470c-b168-acc78c1b1110 service nova] Acquired lock "refresh_cache-ec4a2e9d-de37-4e9b-840f-9c112f1b0789" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.neutron [req-2a40ee08-4337-4ebe-b4ea-a985b494f862 req-da013d49-e27a-470c-b168-acc78c1b1110 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Refreshing network info cache for port 91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Start _get_guest_xml network_info=[{"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:31:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:31:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1513902143',display_name='tempest-VolumesActionsTest-instance-1513902143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1513902143',id=30,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2985007d7c04c68880c89199595e184',ramdisk_id='',reservation_id='r-tp1sh5cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2111151066',owner_user_name='tempest-VolumesActionsTest-2111151066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:31:08Z,user_data=None,user_id='0a9eddb7927d4fa2bfd2cce4f2697753',uuid=ec4a2e9d-de37-4e9b-840f-9c112f1b0789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Converting VIF {"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a6,bridge_name='br-int',has_traffic_filtering=True,id=91197a85-92dc-43d1-b9dc-3e8c37e583fe,network=Network(af7fec63-3384-4cd0-a802-77f9fa3310c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91197a85-92') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lazy-loading 'pci_devices' on Instance uuid ec4a2e9d-de37-4e9b-840f-9c112f1b0789 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:31:09 user nova-compute[75102]:   <uuid>ec4a2e9d-de37-4e9b-840f-9c112f1b0789</uuid>
Nov 10 16:31:09 user nova-compute[75102]:   <name>instance-0000001e</name>
Nov 10 16:31:09 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:31:09 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:31:09 user nova-compute[75102]:   <metadata>
Nov 10 16:31:09 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:31:09 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:31:09 user nova-compute[75102]:       <nova:name>tempest-VolumesActionsTest-instance-1513902143</nova:name>
Nov 10 16:31:09 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:31:09</nova:creationTime>
Nov 10 16:31:09 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:31:09 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:31:09 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:31:09 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:31:09 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:31:09 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:31:09 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:31:09 user nova-compute[75102]:       <nova:owner>
Nov 10 16:31:09 user nova-compute[75102]:         <nova:user uuid="0a9eddb7927d4fa2bfd2cce4f2697753">tempest-VolumesActionsTest-2111151066-project-member</nova:user>
Nov 10 16:31:09 user nova-compute[75102]:         <nova:project uuid="a2985007d7c04c68880c89199595e184">tempest-VolumesActionsTest-2111151066</nova:project>
Nov 10 16:31:09 user nova-compute[75102]:       </nova:owner>
Nov 10 16:31:09 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:31:09 user nova-compute[75102]:       <nova:ports>
Nov 10 16:31:09 user nova-compute[75102]:         <nova:port uuid="91197a85-92dc-43d1-b9dc-3e8c37e583fe">
Nov 10 16:31:09 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 16:31:09 user nova-compute[75102]:         </nova:port>
Nov 10 16:31:09 user nova-compute[75102]:       </nova:ports>
Nov 10 16:31:09 user nova-compute[75102]:     </nova:instance>
Nov 10 16:31:09 user nova-compute[75102]:   </metadata>
Nov 10 16:31:09 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:31:09 user nova-compute[75102]:     <system>
Nov 10 16:31:09 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:31:09 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:31:09 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:31:09 user nova-compute[75102]:       <entry name="serial">ec4a2e9d-de37-4e9b-840f-9c112f1b0789</entry>
Nov 10 16:31:09 user nova-compute[75102]:       <entry name="uuid">ec4a2e9d-de37-4e9b-840f-9c112f1b0789</entry>
Nov 10 16:31:09 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:31:09 user nova-compute[75102]:     </system>
Nov 10 16:31:09 user nova-compute[75102]:   </sysinfo>
Nov 10 16:31:09 user nova-compute[75102]:   <os>
Nov 10 16:31:09 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:31:09 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:31:09 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:31:09 user nova-compute[75102]:   </os>
Nov 10 16:31:09 user nova-compute[75102]:   <features>
Nov 10 16:31:09 user nova-compute[75102]:     <acpi/>
Nov 10 16:31:09 user nova-compute[75102]:     <apic/>
Nov 10 16:31:09 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:31:09 user nova-compute[75102]:   </features>
Nov 10 16:31:09 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:31:09 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:31:09 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:31:09 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:31:09 user nova-compute[75102]:   </clock>
Nov 10 16:31:09 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:31:09 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:31:09 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:31:09 user nova-compute[75102]:   </cpu>
Nov 10 16:31:09 user nova-compute[75102]:   <devices>
Nov 10 16:31:09 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:31:09 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:31:09 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk"/>
Nov 10 16:31:09 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:31:09 user nova-compute[75102]:     </disk>
Nov 10 16:31:09 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:31:09 user nova-compute[75102]:       <mac address="fa:16:3e:a2:ac:a6"/>
Nov 10 16:31:09 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:31:09 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:31:09 user nova-compute[75102]:       <target dev="tap91197a85-92"/>
Nov 10 16:31:09 user nova-compute[75102]:     </interface>
Nov 10 16:31:09 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:31:09 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/console.log" append="off"/>
Nov 10 16:31:09 user nova-compute[75102]:     </serial>
Nov 10 16:31:09 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:31:09 user nova-compute[75102]:     <video>
Nov 10 16:31:09 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:31:09 user nova-compute[75102]:     </video>
Nov 10 16:31:09 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:31:09 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:31:09 user nova-compute[75102]:     </rng>
Nov 10 16:31:09 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:31:09 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:31:09 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:31:09 user nova-compute[75102]:     </memballoon>
Nov 10 16:31:09 user nova-compute[75102]:   </devices>
Nov 10 16:31:09 user nova-compute[75102]: </domain>
Nov 10 16:31:09 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1513902143',display_name='tempest-VolumesActionsTest-instance-1513902143',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1513902143',id=30,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a2985007d7c04c68880c89199595e184',ramdisk_id='',reservation_id='r-tp1sh5cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-2111151066',owner_user_name='tempest-VolumesActionsTest-2111151066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:31:08Z,user_data=None,user_id='0a9eddb7927d4fa2bfd2cce4f2697753',uuid=ec4a2e9d-de37-4e9b-840f-9c112f1b0789,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Converting VIF {"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a6,bridge_name='br-int',has_traffic_filtering=True,id=91197a85-92dc-43d1-b9dc-3e8c37e583fe,network=Network(af7fec63-3384-4cd0-a802-77f9fa3310c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91197a85-92') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG os_vif [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a6,bridge_name='br-int',has_traffic_filtering=True,id=91197a85-92dc-43d1-b9dc-3e8c37e583fe,network=Network(af7fec63-3384-4cd0-a802-77f9fa3310c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91197a85-92') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41de5691-0e2a-5f3a-9585-7a0d8e4c6af5', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91197a85-92, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91197a85-92, col_values=(('qos', UUID('f14b0be4-9075-4c44-9541-025cb08c0f05')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91197a85-92, col_values=(('external_ids', {'iface-id': '91197a85-92dc-43d1-b9dc-3e8c37e583fe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a2:ac:a6', 'vm-uuid': 'ec4a2e9d-de37-4e9b-840f-9c112f1b0789'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:09 user nova-compute[75102]: INFO os_vif [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a6,bridge_name='br-int',has_traffic_filtering=True,id=91197a85-92dc-43d1-b9dc-3e8c37e583fe,network=Network(af7fec63-3384-4cd0-a802-77f9fa3310c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91197a85-92')
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:31:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] No VIF found with MAC fa:16:3e:a2:ac:a6, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-2a40ee08-4337-4ebe-b4ea-a985b494f862 req-da013d49-e27a-470c-b168-acc78c1b1110 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Updated VIF entry in instance network info cache for port 91197a85-92dc-43d1-b9dc-3e8c37e583fe. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-2a40ee08-4337-4ebe-b4ea-a985b494f862 req-da013d49-e27a-470c-b168-acc78c1b1110 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Updating instance_info_cache with network_info: [{"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2a40ee08-4337-4ebe-b4ea-a985b494f862 req-da013d49-e27a-470c-b168-acc78c1b1110 service nova] Releasing lock "refresh_cache-ec4a2e9d-de37-4e9b-840f-9c112f1b0789" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating instance_info_cache with network_info: [{"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-1d2937fc-16d6-4167-9b43-f0f44663deda" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-37783c9e-0fb9-4ae5-bd16-ee003ae81ed7 req-9c3b6e11-5166-44ac-8f08-b2e0010f535f service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-37783c9e-0fb9-4ae5-bd16-ee003ae81ed7 req-9c3b6e11-5166-44ac-8f08-b2e0010f535f service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-37783c9e-0fb9-4ae5-bd16-ee003ae81ed7 req-9c3b6e11-5166-44ac-8f08-b2e0010f535f service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-37783c9e-0fb9-4ae5-bd16-ee003ae81ed7 req-9c3b6e11-5166-44ac-8f08-b2e0010f535f service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-37783c9e-0fb9-4ae5-bd16-ee003ae81ed7 req-9c3b6e11-5166-44ac-8f08-b2e0010f535f service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:10 user nova-compute[75102]: WARNING nova.compute.manager [req-37783c9e-0fb9-4ae5-bd16-ee003ae81ed7 req-9c3b6e11-5166-44ac-8f08-b2e0010f535f service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state active and task_state rescuing.
Nov 10 16:31:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:11 user nova-compute[75102]: INFO nova.compute.manager [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Terminating instance
Nov 10 16:31:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-0a469ea4-6a56-4776-ab21-1ab5755ba386 req-0dddf5da-8f67-41d4-9e9c-0fb56a93604f service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received event network-vif-unplugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0a469ea4-6a56-4776-ab21-1ab5755ba386 req-0dddf5da-8f67-41d4-9e9c-0fb56a93604f service nova] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0a469ea4-6a56-4776-ab21-1ab5755ba386 req-0dddf5da-8f67-41d4-9e9c-0fb56a93604f service nova] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0a469ea4-6a56-4776-ab21-1ab5755ba386 req-0dddf5da-8f67-41d4-9e9c-0fb56a93604f service nova] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-0a469ea4-6a56-4776-ab21-1ab5755ba386 req-0dddf5da-8f67-41d4-9e9c-0fb56a93604f service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] No waiting events found dispatching network-vif-unplugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-0a469ea4-6a56-4776-ab21-1ab5755ba386 req-0dddf5da-8f67-41d4-9e9c-0fb56a93604f service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received event network-vif-unplugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-8e1a2713-36cc-4bc7-bf36-2fb6c50148fb req-149f32cb-a0bb-48a2-bf1b-e9362808a8da service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received event network-vif-plugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8e1a2713-36cc-4bc7-bf36-2fb6c50148fb req-149f32cb-a0bb-48a2-bf1b-e9362808a8da service nova] Acquiring lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8e1a2713-36cc-4bc7-bf36-2fb6c50148fb req-149f32cb-a0bb-48a2-bf1b-e9362808a8da service nova] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8e1a2713-36cc-4bc7-bf36-2fb6c50148fb req-149f32cb-a0bb-48a2-bf1b-e9362808a8da service nova] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-8e1a2713-36cc-4bc7-bf36-2fb6c50148fb req-149f32cb-a0bb-48a2-bf1b-e9362808a8da service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] No waiting events found dispatching network-vif-plugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:12 user nova-compute[75102]: WARNING nova.compute.manager [req-8e1a2713-36cc-4bc7-bf36-2fb6c50148fb req-149f32cb-a0bb-48a2-bf1b-e9362808a8da service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received unexpected event network-vif-plugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe for instance with vm_state building and task_state spawning.
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Instance destroyed successfully.
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.objects.instance [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'resources' on Instance uuid a437e642-d3a4-4356-805e-cb68da21167f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-165575473',display_name='tempest-AttachVolumeNegativeTest-server-165575473',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-165575473',id=19,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEJXrLcbP5wpd2+ApL2z9L/LR8Qx3KUH0k4zbPuCJ0rr65tMh16/zOfgEpVEFy+Ae9n7chLaQGYm//FScX3daKg7ht/TgxCcSI9qKyNVgEuzq2hYfVtMforl+Ylkd7/LbA==',key_name='tempest-keypair-800126954',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:25:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-0ajehl70',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:25:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=a437e642-d3a4-4356-805e-cb68da21167f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "address": "fa:16:3e:ab:a7:19", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap64f6cf0e-86", "ovs_interfaceid": "64f6cf0e-865d-401e-b269-2df0b13d43c2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ab:a7:19,bridge_name='br-int',has_traffic_filtering=True,id=64f6cf0e-865d-401e-b269-2df0b13d43c2,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f6cf0e-86') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG os_vif [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:a7:19,bridge_name='br-int',has_traffic_filtering=True,id=64f6cf0e-865d-401e-b269-2df0b13d43c2,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f6cf0e-86') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap64f6cf0e-86, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e39b30b-3c09-4b11-8d76-bd031c114cfd) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:12 user nova-compute[75102]: INFO os_vif [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ab:a7:19,bridge_name='br-int',has_traffic_filtering=True,id=64f6cf0e-865d-401e-b269-2df0b13d43c2,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap64f6cf0e-86')
Nov 10 16:31:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Deleting instance files /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f_del
Nov 10 16:31:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Deletion of /opt/stack/data/nova/instances/a437e642-d3a4-4356-805e-cb68da21167f_del complete
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-dc1f91b0-389b-4600-b537-dccd23ddae00 req-13382e2e-9876-4e76-8aaf-6ac06d17544f service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dc1f91b0-389b-4600-b537-dccd23ddae00 req-13382e2e-9876-4e76-8aaf-6ac06d17544f service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dc1f91b0-389b-4600-b537-dccd23ddae00 req-13382e2e-9876-4e76-8aaf-6ac06d17544f service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dc1f91b0-389b-4600-b537-dccd23ddae00 req-13382e2e-9876-4e76-8aaf-6ac06d17544f service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-dc1f91b0-389b-4600-b537-dccd23ddae00 req-13382e2e-9876-4e76-8aaf-6ac06d17544f service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:12 user nova-compute[75102]: WARNING nova.compute.manager [req-dc1f91b0-389b-4600-b537-dccd23ddae00 req-13382e2e-9876-4e76-8aaf-6ac06d17544f service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state active and task_state rescuing.
Nov 10 16:31:12 user nova-compute[75102]: INFO nova.compute.manager [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Took 1.45 seconds to destroy the instance on the hypervisor.
Nov 10 16:31:12 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:31:12 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: a437e642-d3a4-4356-805e-cb68da21167f] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:31:13 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:31:13 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Took 0.98 seconds to deallocate network for instance.
Nov 10 16:31:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-abe98c7b-fdd6-46d5-8288-3b62bb2fbab3 req-b00d1984-8149-4d8e-9291-24f9b03bef8c service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received event network-vif-plugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-abe98c7b-fdd6-46d5-8288-3b62bb2fbab3 req-b00d1984-8149-4d8e-9291-24f9b03bef8c service nova] Acquiring lock "a437e642-d3a4-4356-805e-cb68da21167f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-abe98c7b-fdd6-46d5-8288-3b62bb2fbab3 req-b00d1984-8149-4d8e-9291-24f9b03bef8c service nova] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-abe98c7b-fdd6-46d5-8288-3b62bb2fbab3 req-b00d1984-8149-4d8e-9291-24f9b03bef8c service nova] Lock "a437e642-d3a4-4356-805e-cb68da21167f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-abe98c7b-fdd6-46d5-8288-3b62bb2fbab3 req-b00d1984-8149-4d8e-9291-24f9b03bef8c service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] No waiting events found dispatching network-vif-plugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:13 user nova-compute[75102]: WARNING nova.compute.manager [req-abe98c7b-fdd6-46d5-8288-3b62bb2fbab3 req-b00d1984-8149-4d8e-9291-24f9b03bef8c service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received unexpected event network-vif-plugged-64f6cf0e-865d-401e-b269-2df0b13d43c2 for instance with vm_state active and task_state deleting.
Nov 10 16:31:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-abe98c7b-fdd6-46d5-8288-3b62bb2fbab3 req-b00d1984-8149-4d8e-9291-24f9b03bef8c service nova] [instance: a437e642-d3a4-4356-805e-cb68da21167f] Received event network-vif-deleted-64f6cf0e-865d-401e-b269-2df0b13d43c2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-53c45aab-0cca-45d5-819a-cd3b6e575d9d req-a31f0071-1831-4430-8b35-2f2f38df917e service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received event network-vif-plugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-53c45aab-0cca-45d5-819a-cd3b6e575d9d req-a31f0071-1831-4430-8b35-2f2f38df917e service nova] Acquiring lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-53c45aab-0cca-45d5-819a-cd3b6e575d9d req-a31f0071-1831-4430-8b35-2f2f38df917e service nova] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-53c45aab-0cca-45d5-819a-cd3b6e575d9d req-a31f0071-1831-4430-8b35-2f2f38df917e service nova] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-53c45aab-0cca-45d5-819a-cd3b6e575d9d req-a31f0071-1831-4430-8b35-2f2f38df917e service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] No waiting events found dispatching network-vif-plugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:14 user nova-compute[75102]: WARNING nova.compute.manager [req-53c45aab-0cca-45d5-819a-cd3b6e575d9d req-a31f0071-1831-4430-8b35-2f2f38df917e service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received unexpected event network-vif-plugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe for instance with vm_state building and task_state spawning.
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPEwNJsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:31:14 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:31:14 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:31:14 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[de43cb3d-2ae9-4793-9edf-b0b45907eb5e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:31:14 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[22dea50b-6704-4358-9892-ad887d24ce8b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d] added
Nov 10 16:31:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aeb5d53-9f66-4fc0-9b2a-df0451b40e7e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.454s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a33d257-76dc-4c28-982f-0e980ace0817]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPEwNJsM {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Deleted allocations for instance a437e642-d3a4-4356-805e-cb68da21167f
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPEwNJsM" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f78fb40-d313-44ed-8f7b-3bf32771f1e4]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gPEwNJsM'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca67d7-f0d4-463e-8171-10295b966d0f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5c8922f7-2638-4b36-96b6-046c6420aa92 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec57746-41d6-4e44-a712-5cd468458016]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-edd19584-eb76-42b4-a12d-40d054c5ebf1 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "a437e642-d3a4-4356-805e-cb68da21167f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.160s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5628c984-17f9-46e6-b16e-3248da7efd9b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260]
Nov 10 16:31:14 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260] successful.
Nov 10 16:31:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8758624-41c3-4e6d-a36b-405e1bda66c3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0511b007-f51a-4acc-af4a-adbeeeeb9f64]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:31:14 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] HCTL ('34', '-', '-', 0) found on session 27 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e085fd9-d08e-48e8-a6a8-34774c6f40b3]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching for a device in session 27 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPEwNJsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:31:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Instance spawned successfully.
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:14 user nova-compute[75102]: INFO nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 10 16:31:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:31:15 user nova-compute[75102]: INFO nova.compute.manager [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Took 10.79 seconds to build instance.
Nov 10 16:31:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c0b9bafd-5710-4c93-b153-cbcba84e0249 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.946s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.382s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:31:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== connect_volume: return (1386ms) {'type': 'block', 'scsi_wwn': '26235646633363663', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:31:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235646633363663', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:31:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'flavor' on Instance uuid 22865b86-3ce3-4ec7-89c4-fc08684a0a60 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:31:15 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:31:15 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:31:15 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:31:15 user nova-compute[75102]:   <serial>eec57ecc-343d-493d-8d69-2a8f3752e72d</serial>
Nov 10 16:31:15 user nova-compute[75102]: </disk>
Nov 10 16:31:15 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:31:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:31:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:31:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No VIF found with MAC fa:16:3e:d0:a8:da, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:31:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3981e529-a2c6-4ce8-99c9-7adfee891018 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 31.950s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:18 user nova-compute[75102]: INFO nova.compute.manager [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Rebuilding instance
Nov 10 16:31:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-215759fa-f751-4026-a337-2b069b5b0d3d req-e268c38a-4db8-4453-97d9-86beb12d1375 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-unplugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-215759fa-f751-4026-a337-2b069b5b0d3d req-e268c38a-4db8-4453-97d9-86beb12d1375 service nova] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-215759fa-f751-4026-a337-2b069b5b0d3d req-e268c38a-4db8-4453-97d9-86beb12d1375 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-215759fa-f751-4026-a337-2b069b5b0d3d req-e268c38a-4db8-4453-97d9-86beb12d1375 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-215759fa-f751-4026-a337-2b069b5b0d3d req-e268c38a-4db8-4453-97d9-86beb12d1375 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] No waiting events found dispatching network-vif-unplugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:19 user nova-compute[75102]: WARNING nova.compute.manager [req-215759fa-f751-4026-a337-2b069b5b0d3d req-e268c38a-4db8-4453-97d9-86beb12d1375 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received unexpected event network-vif-unplugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 for instance with vm_state active and task_state rebuilding.
Nov 10 16:31:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Instance destroyed successfully.
Nov 10 16:31:19 user nova-compute[75102]: INFO nova.compute.manager [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Detaching volume eec57ecc-343d-493d-8d69-2a8f3752e72d
Nov 10 16:31:19 user nova-compute[75102]: INFO nova.virt.block_device [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Attempting to driver detach volume eec57ecc-343d-493d-8d69-2a8f3752e72d from mountpoint /dev/vdb
Nov 10 16:31:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Attempting to detach device vdb from instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:31:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:31:19 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:31:19 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:31:19 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:31:19 user nova-compute[75102]:   <serial>eec57ecc-343d-493d-8d69-2a8f3752e72d</serial>
Nov 10 16:31:19 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:31:19 user nova-compute[75102]: </disk>
Nov 10 16:31:19 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:31:20 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully detached device vdb from instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 from the persistent domain config.
Nov 10 16:31:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPEwNJsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:31:20 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d29016f-04bf-4eab-95f3-ad069246c004]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:31:20 user nova-compute[75102]: No targets found.
Nov 10 16:31:20 user nova-compute[75102]: iSNS:
Nov 10 16:31:20 user nova-compute[75102]: No targets found.
Nov 10 16:31:20 user nova-compute[75102]: STATIC:
Nov 10 16:31:20 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62
Nov 10 16:31:20 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:31:20 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:31:20 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d
Nov 10 16:31:20 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:31:20 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:31:20 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0
Nov 10 16:31:20 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:31:20 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:31:20 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:31:20 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:31:20 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:31:20 user nova-compute[75102]: FIRMWARE:
Nov 10 16:31:20 user nova-compute[75102]: No targets found.
Nov 10 16:31:20 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:31:20 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:31:20 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4cd895-a9cf-4a83-a3b4-74f354eff8a2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7a75eec-9c68-473a-8212-74f84b6d1b09]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7456bd00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a987d6-d368-4291-9b93-5bcd5c477a86]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5aba034-a526-4767-80eb-2c1e4f68a780]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d3836f-2bb0-4c84-9358-689da65592f3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[69cf782b-3485-4000-8a26-77d22fe12bb9]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1d2937fc-16d6-4167-9b43-f0f44663deda is timed out.
Nov 10 16:31:20 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Successfully detached device vdb from instance 1d2937fc-16d6-4167-9b43-f0f44663deda from the live domain config.
Nov 10 16:31:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YQeiCJaN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:31:20 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee7f995-5e65-4de8-b341-24dc30d1f076]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b76c5d63-12e0-4bbc-9ff2-fa0652a01492]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260]
Nov 10 16:31:20 user nova-compute[75102]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260] successful.
Nov 10 16:31:20 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bd1437c-70c5-4ffd-aa1b-9ff9a96d5cf9]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.343s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== disconnect_volume: return (346ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.111s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c7e5cc-0aa2-42ba-a3ff-581641337e3a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:31:20 user nova-compute[75102]: No targets found.
Nov 10 16:31:20 user nova-compute[75102]: iSNS:
Nov 10 16:31:20 user nova-compute[75102]: No targets found.
Nov 10 16:31:20 user nova-compute[75102]: STATIC:
Nov 10 16:31:20 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62
Nov 10 16:31:20 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:31:20 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:31:20 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0
Nov 10 16:31:20 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:31:20 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:31:20 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:31:20 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:31:20 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:31:20 user nova-compute[75102]: FIRMWARE:
Nov 10 16:31:20 user nova-compute[75102]: No targets found.
Nov 10 16:31:20 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:31:20 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:31:20 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3194df2b-065d-42de-b20d-711128a9ed5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f143205-bcd2-45a4-a7d8-9c9ad128f113]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:20 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74586710>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[143a8abd-315d-4d34-a261-5730f82162a7]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dd4964-b042-4853-81de-364f88891a6a]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a58fe7-1b9e-4037-8766-8a0c48c1cb18]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.040s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3803a35-2029-4e8b-822d-ea958cf95992]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[16e49d2c-0621-4341-9037-a10b46267352]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3fe7a8-8d40-42df-83b7-994a23d3ae21]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0, portal: 172.16.0.220,3260]
Nov 10 16:31:20 user nova-compute[75102]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0, portal: 172.16.0.220,3260] successful.
Nov 10 16:31:20 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:856178a7-34e8-488b-9157-1068f28b5eb0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b10ac60-0891-4ef9-baab-f45be3fb14fa]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.355s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] <== disconnect_volume: return (466ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:31:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-8fe34d35-03cc-426d-aa9d-2ebe1afa0c8f req-64e2d570-0820-41d9-b879-b57d93879d0c service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8fe34d35-03cc-426d-aa9d-2ebe1afa0c8f req-64e2d570-0820-41d9-b879-b57d93879d0c service nova] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8fe34d35-03cc-426d-aa9d-2ebe1afa0c8f req-64e2d570-0820-41d9-b879-b57d93879d0c service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8fe34d35-03cc-426d-aa9d-2ebe1afa0c8f req-64e2d570-0820-41d9-b879-b57d93879d0c service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-8fe34d35-03cc-426d-aa9d-2ebe1afa0c8f req-64e2d570-0820-41d9-b879-b57d93879d0c service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] No waiting events found dispatching network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:21 user nova-compute[75102]: WARNING nova.compute.manager [req-8fe34d35-03cc-426d-aa9d-2ebe1afa0c8f req-64e2d570-0820-41d9-b879-b57d93879d0c service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received unexpected event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 for instance with vm_state active and task_state rebuilding.
Nov 10 16:31:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Instance destroyed successfully.
Nov 10 16:31:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1369602086',display_name='tempest-ServerActionsTestOtherA-server-572106926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1369602086',id=28,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS9aEsC9DkyiXkRLS5dGIYoAHUIm63zekg0VMpktGwjiXXfqBh0WaQ64TY7S97+mYuRLBNgDzeBuXpCBuN7hevXuih4l498smbzR6XPH3ZHHk/XQcFpZYMuQ6Hr0yiLvg==',key_name='tempest-keypair-439595601',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:28:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-y3on4ld3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:31:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=22865b86-3ce3-4ec7-89c4-fc08684a0a60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_vif [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap463f7077-f0, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9e9a502c-b5f3-4fad-b7fb-c4aefc37c5a9) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:21 user nova-compute[75102]: INFO os_vif [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0')
Nov 10 16:31:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPEwNJsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:31:21 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9267025d-e384-4270-9579-f616f969938f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:31:21 user nova-compute[75102]: No targets found.
Nov 10 16:31:21 user nova-compute[75102]: iSNS:
Nov 10 16:31:21 user nova-compute[75102]: No targets found.
Nov 10 16:31:21 user nova-compute[75102]: STATIC:
Nov 10 16:31:21 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62
Nov 10 16:31:21 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:31:21 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:31:21 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:31:21 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:31:21 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:31:21 user nova-compute[75102]: FIRMWARE:
Nov 10 16:31:21 user nova-compute[75102]: No targets found.
Nov 10 16:31:21 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:31:21 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:31:21 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[66ec3e1c-47eb-4943-8de6-577027d50b61]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[08abce22-2a6d-4b94-b7ce-fe5245a9d2ba]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:21 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:21 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:21 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:21 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74585a20>, {}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Disconnecting from: [] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.084s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== disconnect_volume: return (85ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:31:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Deleting instance files /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60_del
Nov 10 16:31:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Deletion of /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60_del complete
Nov 10 16:31:21 user nova-compute[75102]: DEBUG nova.objects.instance [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'flavor' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:21 user nova-compute[75102]: INFO nova.virt.block_device [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Booting with volume eec57ecc-343d-493d-8d69-2a8f3752e72d at /dev/vdb
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-cdac4252-3a7b-4f7b-9dea-bcead5eb3a46 tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.127s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG os_brick.utils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c562f9-84d6-442e-a54d-e32cf33e1d26]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7293f08e-dbf0-4b01-ac8a-f2ec6287c1a2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbdd29bb-3efa-4595-bcfa-0b3d1d0e70f4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a30c71-0754-48fd-b5ef-4e59a6832886]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:31:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:31:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:31:22 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:31:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd76934-75fb-4e31-bb5e-fa1b457e5b3a]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:31:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:31:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:31:22 user nova-compute[75102]: DEBUG os_brick.utils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:31:22 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Updating existing volume attachment record: cbb56acf-f742-46cd-b66b-9349e951dcc5 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:31:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:31:47 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Creating image(s)
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk 1073741824" returned: 0 in 0.123s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.306s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Checking if we can resize image /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Cannot resize image /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Ensure instance console log exists: /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Start _get_guest_xml network_info=[{"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'cbb56acf-f742-46cd-b66b-9349e951dcc5', 'boot_index': None, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPEwNJsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '22865b86-3ce3-4ec7-89c4-fc08684a0a60', 'attached_at': '', 'detached_at': '', 'volume_id': 'eec57ecc-343d-493d-8d69-2a8f3752e72d', 'serial': 'eec57ecc-343d-493d-8d69-2a8f3752e72d'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:31:48 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 16:31:48 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'vcpu_model' on Instance uuid 22865b86-3ce3-4ec7-89c4-fc08684a0a60 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPEwNJsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:31:48 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:31:48 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:31:48 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a49e8a18-bfe2-4f01-846d-ffd1c81faa4d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:31:48 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1db268-bba5-475a-a7ab-5fbad638b235]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d] added
Nov 10 16:31:48 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[88833889-c9bb-4bfc-b752-3632486ff8cc]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cef501-23f0-44f9-92e5-57d3a31fb751]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPEwNJsM {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gPEwNJsM" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b1f1cf-d123-48df-8142-f3460148d4c9]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gPEwNJsM'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a007604-26f6-4137-a543-7a29a7dc5dfd]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e62e2d-95e7-4e7d-a73c-cf2dabdff333]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:48 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:48 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:48 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:48 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e1474e-345f-4216-96c0-c8346144cbda]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260]
Nov 10 16:31:48 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260] successful.
Nov 10 16:31:48 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1a4530-d3ec-4ea4-bc9d-b207340ec86d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[51bd71f5-cc97-4898-99f0-4e9322a994f8]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:48 user nova-compute[75102]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:31:48 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:48 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:31:48 user nova-compute[75102]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:31:48 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:31:48 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.292s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] HCTL ('34', '-', '-', 0) found on session 28 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c7d2dc7-e5ab-45ed-b600-619aea0beaa1]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching for a device in session 28 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:31:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPEwNJsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:49 user nova-compute[75102]: INFO nova.compute.manager [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Terminating instance
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26235646633363663', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235646633363663', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1369602086',display_name='tempest-ServerActionsTestOtherA-server-572106926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1369602086',id=28,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS9aEsC9DkyiXkRLS5dGIYoAHUIm63zekg0VMpktGwjiXXfqBh0WaQ64TY7S97+mYuRLBNgDzeBuXpCBuN7hevXuih4l498smbzR6XPH3ZHHk/XQcFpZYMuQ6Hr0yiLvg==',key_name='tempest-keypair-439595601',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:28:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-y3on4ld3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:31:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=22865b86-3ce3-4ec7-89c4-fc08684a0a60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:31:49 user nova-compute[75102]:   <uuid>22865b86-3ce3-4ec7-89c4-fc08684a0a60</uuid>
Nov 10 16:31:49 user nova-compute[75102]:   <name>instance-0000001c</name>
Nov 10 16:31:49 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:31:49 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:31:49 user nova-compute[75102]:   <metadata>
Nov 10 16:31:49 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:31:49 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:31:49 user nova-compute[75102]:       <nova:name>tempest-ServerActionsTestOtherA-server-572106926</nova:name>
Nov 10 16:31:49 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:31:48</nova:creationTime>
Nov 10 16:31:49 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:31:49 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:31:49 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:31:49 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:31:49 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:31:49 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:31:49 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:31:49 user nova-compute[75102]:       <nova:owner>
Nov 10 16:31:49 user nova-compute[75102]:         <nova:user uuid="7bbea9eecf0b4e998ad458bc0d30a5bf">tempest-ServerActionsTestOtherA-1931720116-project-member</nova:user>
Nov 10 16:31:49 user nova-compute[75102]:         <nova:project uuid="46f5704b433744dd8188e61d576dd461">tempest-ServerActionsTestOtherA-1931720116</nova:project>
Nov 10 16:31:49 user nova-compute[75102]:       </nova:owner>
Nov 10 16:31:49 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:31:49 user nova-compute[75102]:       <nova:ports>
Nov 10 16:31:49 user nova-compute[75102]:         <nova:port uuid="463f7077-f0c7-4f09-b53b-6d374ec16fa2">
Nov 10 16:31:49 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 16:31:49 user nova-compute[75102]:         </nova:port>
Nov 10 16:31:49 user nova-compute[75102]:       </nova:ports>
Nov 10 16:31:49 user nova-compute[75102]:     </nova:instance>
Nov 10 16:31:49 user nova-compute[75102]:   </metadata>
Nov 10 16:31:49 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:31:49 user nova-compute[75102]:     <system>
Nov 10 16:31:49 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:31:49 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:31:49 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:31:49 user nova-compute[75102]:       <entry name="serial">22865b86-3ce3-4ec7-89c4-fc08684a0a60</entry>
Nov 10 16:31:49 user nova-compute[75102]:       <entry name="uuid">22865b86-3ce3-4ec7-89c4-fc08684a0a60</entry>
Nov 10 16:31:49 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:31:49 user nova-compute[75102]:     </system>
Nov 10 16:31:49 user nova-compute[75102]:   </sysinfo>
Nov 10 16:31:49 user nova-compute[75102]:   <os>
Nov 10 16:31:49 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:31:49 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:31:49 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:31:49 user nova-compute[75102]:   </os>
Nov 10 16:31:49 user nova-compute[75102]:   <features>
Nov 10 16:31:49 user nova-compute[75102]:     <acpi/>
Nov 10 16:31:49 user nova-compute[75102]:     <apic/>
Nov 10 16:31:49 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:31:49 user nova-compute[75102]:   </features>
Nov 10 16:31:49 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:31:49 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:31:49 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:31:49 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:31:49 user nova-compute[75102]:   </clock>
Nov 10 16:31:49 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:31:49 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:31:49 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:31:49 user nova-compute[75102]:   </cpu>
Nov 10 16:31:49 user nova-compute[75102]:   <devices>
Nov 10 16:31:49 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:31:49 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:31:49 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk"/>
Nov 10 16:31:49 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:31:49 user nova-compute[75102]:     </disk>
Nov 10 16:31:49 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:31:49 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:31:49 user nova-compute[75102]:       <source dev="/dev/sdc"/>
Nov 10 16:31:49 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:31:49 user nova-compute[75102]:       <serial>eec57ecc-343d-493d-8d69-2a8f3752e72d</serial>
Nov 10 16:31:49 user nova-compute[75102]:     </disk>
Nov 10 16:31:49 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:31:49 user nova-compute[75102]:       <mac address="fa:16:3e:d0:a8:da"/>
Nov 10 16:31:49 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:31:49 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:31:49 user nova-compute[75102]:       <target dev="tap463f7077-f0"/>
Nov 10 16:31:49 user nova-compute[75102]:     </interface>
Nov 10 16:31:49 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:31:49 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/console.log" append="off"/>
Nov 10 16:31:49 user nova-compute[75102]:     </serial>
Nov 10 16:31:49 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:31:49 user nova-compute[75102]:     <video>
Nov 10 16:31:49 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:31:49 user nova-compute[75102]:     </video>
Nov 10 16:31:49 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:31:49 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:31:49 user nova-compute[75102]:     </rng>
Nov 10 16:31:49 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:31:49 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:31:49 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:31:49 user nova-compute[75102]:     </memballoon>
Nov 10 16:31:49 user nova-compute[75102]:   </devices>
Nov 10 16:31:49 user nova-compute[75102]: </domain>
Nov 10 16:31:49 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1369602086',display_name='tempest-ServerActionsTestOtherA-server-572106926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1369602086',id=28,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS9aEsC9DkyiXkRLS5dGIYoAHUIm63zekg0VMpktGwjiXXfqBh0WaQ64TY7S97+mYuRLBNgDzeBuXpCBuN7hevXuih4l498smbzR6XPH3ZHHk/XQcFpZYMuQ6Hr0yiLvg==',key_name='tempest-keypair-439595601',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:28:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-y3on4ld3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:31:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=22865b86-3ce3-4ec7-89c4-fc08684a0a60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG os_vif [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c38ddf09-391f-52fe-97d9-3cf85d72b8de', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap463f7077-f0, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap463f7077-f0, col_values=(('qos', UUID('4758b9e9-7d0e-4c24-905a-363b72e5d67d')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap463f7077-f0, col_values=(('external_ids', {'iface-id': '463f7077-f0c7-4f09-b53b-6d374ec16fa2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d0:a8:da', 'vm-uuid': '22865b86-3ce3-4ec7-89c4-fc08684a0a60'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:49 user nova-compute[75102]: INFO os_vif [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0')
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:31:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No VIF found with MAC fa:16:3e:d0:a8:da, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-56b43ff9-d53f-489d-bc7f-264ba6c8fa2f req-e8668ab3-084e-49f6-b2be-dbca5f4cc4a2 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-unplugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-56b43ff9-d53f-489d-bc7f-264ba6c8fa2f req-e8668ab3-084e-49f6-b2be-dbca5f4cc4a2 service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-56b43ff9-d53f-489d-bc7f-264ba6c8fa2f req-e8668ab3-084e-49f6-b2be-dbca5f4cc4a2 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-56b43ff9-d53f-489d-bc7f-264ba6c8fa2f req-e8668ab3-084e-49f6-b2be-dbca5f4cc4a2 service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-56b43ff9-d53f-489d-bc7f-264ba6c8fa2f req-e8668ab3-084e-49f6-b2be-dbca5f4cc4a2 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-unplugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-56b43ff9-d53f-489d-bc7f-264ba6c8fa2f req-e8668ab3-084e-49f6-b2be-dbca5f4cc4a2 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-unplugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:31:50 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Instance destroyed successfully.
Nov 10 16:31:50 user nova-compute[75102]: DEBUG nova.objects.instance [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lazy-loading 'resources' on Instance uuid 1d2937fc-16d6-4167-9b43-f0f44663deda {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:24:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-99936376',display_name='tempest-ServerStableDeviceRescueTest-server-99936376',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-99936376',id=17,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3swAiY8IXi0LnDIDxdU5FjDWvfkVZ1YU60EUEocwoFUqORwq5Ulkba+xhxutRCA/obuR4eZ0OFPXP2AvkMlrjPBU9bb7EzeBuLnkEcOhPrf7ZVeVhNdp6h6lDwURsHtg==',key_name='tempest-keypair-1511821701',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:28:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='938b3e81d96f48d5977b4e676260a5a5',ramdisk_id='',reservation_id='r-o2v2dsqs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1704477030',owner_user_name='tempest-ServerStableDeviceRescueTest-1704477030-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:30:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c2125de3b2d6404c8391d3dce984dc67',uuid=1d2937fc-16d6-4167-9b43-f0f44663deda,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Converting VIF {"id": "717a43fb-d615-4290-806b-cfaa817bee6f", "address": "fa:16:3e:3a:38:ba", "network": {"id": "d2738093-d847-44d1-9d52-92240b21aa1d", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-116321078-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.207", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "938b3e81d96f48d5977b4e676260a5a5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap717a43fb-d6", "ovs_interfaceid": "717a43fb-d615-4290-806b-cfaa817bee6f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:38:ba,bridge_name='br-int',has_traffic_filtering=True,id=717a43fb-d615-4290-806b-cfaa817bee6f,network=Network(d2738093-d847-44d1-9d52-92240b21aa1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717a43fb-d6') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG os_vif [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:38:ba,bridge_name='br-int',has_traffic_filtering=True,id=717a43fb-d615-4290-806b-cfaa817bee6f,network=Network(d2738093-d847-44d1-9d52-92240b21aa1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717a43fb-d6') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap717a43fb-d6, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c29e047b-6ec3-4d11-b6f4-5efd877edd30) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:50 user nova-compute[75102]: INFO os_vif [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:38:ba,bridge_name='br-int',has_traffic_filtering=True,id=717a43fb-d615-4290-806b-cfaa817bee6f,network=Network(d2738093-d847-44d1-9d52-92240b21aa1d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap717a43fb-d6')
Nov 10 16:31:50 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Deleting instance files /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda_del
Nov 10 16:31:50 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Deletion of /opt/stack/data/nova/instances/1d2937fc-16d6-4167-9b43-f0f44663deda_del complete
Nov 10 16:31:50 user nova-compute[75102]: INFO nova.compute.manager [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 10 16:31:50 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:31:50 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-38f1f7e3-9ec6-4b1a-8b7e-5db78b1a4414 req-18d12fd6-ed98-452f-9bdc-c6b35f777537 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-38f1f7e3-9ec6-4b1a-8b7e-5db78b1a4414 req-18d12fd6-ed98-452f-9bdc-c6b35f777537 service nova] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-38f1f7e3-9ec6-4b1a-8b7e-5db78b1a4414 req-18d12fd6-ed98-452f-9bdc-c6b35f777537 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-38f1f7e3-9ec6-4b1a-8b7e-5db78b1a4414 req-18d12fd6-ed98-452f-9bdc-c6b35f777537 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-38f1f7e3-9ec6-4b1a-8b7e-5db78b1a4414 req-18d12fd6-ed98-452f-9bdc-c6b35f777537 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] No waiting events found dispatching network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:51 user nova-compute[75102]: WARNING nova.compute.manager [req-38f1f7e3-9ec6-4b1a-8b7e-5db78b1a4414 req-18d12fd6-ed98-452f-9bdc-c6b35f777537 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received unexpected event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 16:31:52 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:31:52 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Took 1.66 seconds to deallocate network for instance.
Nov 10 16:31:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-2ca34c97-66aa-42eb-adfb-f3a0eae56bf4 req-a46b1419-0548-45f8-8f36-de7dcc060a1f service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2ca34c97-66aa-42eb-adfb-f3a0eae56bf4 req-a46b1419-0548-45f8-8f36-de7dcc060a1f service nova] Acquiring lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2ca34c97-66aa-42eb-adfb-f3a0eae56bf4 req-a46b1419-0548-45f8-8f36-de7dcc060a1f service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2ca34c97-66aa-42eb-adfb-f3a0eae56bf4 req-a46b1419-0548-45f8-8f36-de7dcc060a1f service nova] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-2ca34c97-66aa-42eb-adfb-f3a0eae56bf4 req-a46b1419-0548-45f8-8f36-de7dcc060a1f service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] No waiting events found dispatching network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:52 user nova-compute[75102]: WARNING nova.compute.manager [req-2ca34c97-66aa-42eb-adfb-f3a0eae56bf4 req-a46b1419-0548-45f8-8f36-de7dcc060a1f service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received unexpected event network-vif-plugged-717a43fb-d615-4290-806b-cfaa817bee6f for instance with vm_state active and task_state deleting.
Nov 10 16:31:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:52 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:31:52 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:31:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.388s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:52 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Deleted allocations for instance 1d2937fc-16d6-4167-9b43-f0f44663deda
Nov 10 16:31:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-38358afd-e97b-4355-b733-6f9287252bee tempest-ServerStableDeviceRescueTest-1704477030 tempest-ServerStableDeviceRescueTest-1704477030-project-member] Lock "1d2937fc-16d6-4167-9b43-f0f44663deda" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.528s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:31:53 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Instance spawned successfully.
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.compute.manager [req-1fbc548f-4dd1-497b-8323-46ba8398b4ee req-982cf89b-e502-4fdf-bbd8-ce5eb54a6012 service nova] [instance: 1d2937fc-16d6-4167-9b43-f0f44663deda] Received event network-vif-deleted-717a43fb-d615-4290-806b-cfaa817bee6f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.compute.manager [req-1fbc548f-4dd1-497b-8323-46ba8398b4ee req-982cf89b-e502-4fdf-bbd8-ce5eb54a6012 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1fbc548f-4dd1-497b-8323-46ba8398b4ee req-982cf89b-e502-4fdf-bbd8-ce5eb54a6012 service nova] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1fbc548f-4dd1-497b-8323-46ba8398b4ee req-982cf89b-e502-4fdf-bbd8-ce5eb54a6012 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1fbc548f-4dd1-497b-8323-46ba8398b4ee req-982cf89b-e502-4fdf-bbd8-ce5eb54a6012 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.compute.manager [req-1fbc548f-4dd1-497b-8323-46ba8398b4ee req-982cf89b-e502-4fdf-bbd8-ce5eb54a6012 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] No waiting events found dispatching network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:31:53 user nova-compute[75102]: WARNING nova.compute.manager [req-1fbc548f-4dd1-497b-8323-46ba8398b4ee req-982cf89b-e502-4fdf-bbd8-ce5eb54a6012 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received unexpected event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 for instance with vm_state active and task_state rebuild_spawning.
Nov 10 16:31:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:53 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75102) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 10 16:31:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c5ca323e-0852-4005-a63e-2abca540d888 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.075s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'flavor' on Instance uuid c34e2e7a-11a3-4718-9d67-f3eab7f21e4b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.075s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:31:56 user nova-compute[75102]: INFO nova.compute.manager [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Attaching volume a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 to /dev/vdb
Nov 10 16:31:56 user nova-compute[75102]: DEBUG os_brick.utils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d5468-596d-40c0-af02-678dfef88b54]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0dcab3-6355-43dc-916f-35137682a96f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a57eac-a94b-445c-b124-e0915f7dc07c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e0a804-d181-49b0-a247-3ac66f1f23fc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:31:56 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:31:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5446a393-b9c7-4aa5-99bb-a4a16920e076]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG os_brick.utils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:31:56 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updating existing volume attachment record: 82e6599f-f215-4ccb-88e3-6f7bd6519ef9 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:31:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:31:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:31:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:31:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:31:59 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:31:59 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:32:00 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:32:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:32:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:32:00 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Updating instance_info_cache with network_info: [{"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.264s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:32:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:32:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.247s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.258s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.252s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:32:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.rescue --force-share --output=json" returned: 0 in 0.225s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f/disk.rescue --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:05 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:32:05 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:32:05 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7880MB free_disk=25.031131744384766GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:32:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6c571e41-3f17-40f4-bcbc-4f3f86585d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ec4a2e9d-de37-4e9b-840f-9c112f1b0789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:32:06 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.077s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:32:07 user nova-compute[75102]: INFO nova.compute.claims [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Claim successful on node user
Nov 10 16:32:07 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.480s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:32:07 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:32:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:32:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG nova.policy [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e290c40d1bac47f9aa06185efefbb4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e388a924d2546fabfefe82c241ecbb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:32:08 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Creating image(s)
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "/opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "/opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "/opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk 1073741824" returned: 0 in 0.055s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.272s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:08 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Successfully created port: 2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Cannot resize image /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Ensure instance console log exists: /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Successfully updated port: 2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "refresh_cache-68e8fc6f-6d54-4804-b45c-4096f68a3894" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquired lock "refresh_cache-68e8fc6f-6d54-4804-b45c-4096f68a3894" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-fde1c41e-5b75-406a-ab9c-16444e02880a req-8ba1930e-9764-4169-bfe5-b3618896dc15 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received event network-changed-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-fde1c41e-5b75-406a-ab9c-16444e02880a req-8ba1930e-9764-4169-bfe5-b3618896dc15 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Refreshing instance network info cache due to event network-changed-2eab767d-a59a-487a-9d00-839cb9f5f89a. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fde1c41e-5b75-406a-ab9c-16444e02880a req-8ba1930e-9764-4169-bfe5-b3618896dc15 service nova] Acquiring lock "refresh_cache-68e8fc6f-6d54-4804-b45c-4096f68a3894" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Updating instance_info_cache with network_info: [{"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Releasing lock "refresh_cache-68e8fc6f-6d54-4804-b45c-4096f68a3894" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Instance network_info: |[{"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fde1c41e-5b75-406a-ab9c-16444e02880a req-8ba1930e-9764-4169-bfe5-b3618896dc15 service nova] Acquired lock "refresh_cache-68e8fc6f-6d54-4804-b45c-4096f68a3894" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-fde1c41e-5b75-406a-ab9c-16444e02880a req-8ba1930e-9764-4169-bfe5-b3618896dc15 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Refreshing network info cache for port 2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Start _get_guest_xml network_info=[{"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:32:10 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:32:10 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1354456878',display_name='tempest-AttachVolumeNegativeTest-server-1354456878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1354456878',id=31,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQrhby4GVZ1t1sxulT6PA8X7EUrkwe/hyNYueQwQicRri8w0HAdkqmjanYUQhAri6K/0gT/qpuFZ7wEqlPjbi40uc2NmJPACd6BowizWXwstwmEm+y2pQ++XzjiPR/OZA==',key_name='tempest-keypair-1619472905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-lf7hv5rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:32:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=68e8fc6f-6d54-4804-b45c-4096f68a3894,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:36:9d,bridge_name='br-int',has_traffic_filtering=True,id=2eab767d-a59a-487a-9d00-839cb9f5f89a,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab767d-a5') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.objects.instance [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'pci_devices' on Instance uuid 68e8fc6f-6d54-4804-b45c-4096f68a3894 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:32:10 user nova-compute[75102]:   <uuid>68e8fc6f-6d54-4804-b45c-4096f68a3894</uuid>
Nov 10 16:32:10 user nova-compute[75102]:   <name>instance-0000001f</name>
Nov 10 16:32:10 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:32:10 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:32:10 user nova-compute[75102]:   <metadata>
Nov 10 16:32:10 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:32:10 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:32:10 user nova-compute[75102]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1354456878</nova:name>
Nov 10 16:32:10 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:32:10</nova:creationTime>
Nov 10 16:32:10 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:32:10 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:32:10 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:32:10 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:32:10 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:32:10 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:32:10 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:32:10 user nova-compute[75102]:       <nova:owner>
Nov 10 16:32:10 user nova-compute[75102]:         <nova:user uuid="e290c40d1bac47f9aa06185efefbb4bd">tempest-AttachVolumeNegativeTest-1745402198-project-member</nova:user>
Nov 10 16:32:10 user nova-compute[75102]:         <nova:project uuid="6e388a924d2546fabfefe82c241ecbb1">tempest-AttachVolumeNegativeTest-1745402198</nova:project>
Nov 10 16:32:10 user nova-compute[75102]:       </nova:owner>
Nov 10 16:32:10 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:32:10 user nova-compute[75102]:       <nova:ports>
Nov 10 16:32:10 user nova-compute[75102]:         <nova:port uuid="2eab767d-a59a-487a-9d00-839cb9f5f89a">
Nov 10 16:32:10 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 16:32:10 user nova-compute[75102]:         </nova:port>
Nov 10 16:32:10 user nova-compute[75102]:       </nova:ports>
Nov 10 16:32:10 user nova-compute[75102]:     </nova:instance>
Nov 10 16:32:10 user nova-compute[75102]:   </metadata>
Nov 10 16:32:10 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:32:10 user nova-compute[75102]:     <system>
Nov 10 16:32:10 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:32:10 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:32:10 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:32:10 user nova-compute[75102]:       <entry name="serial">68e8fc6f-6d54-4804-b45c-4096f68a3894</entry>
Nov 10 16:32:10 user nova-compute[75102]:       <entry name="uuid">68e8fc6f-6d54-4804-b45c-4096f68a3894</entry>
Nov 10 16:32:10 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:32:10 user nova-compute[75102]:     </system>
Nov 10 16:32:10 user nova-compute[75102]:   </sysinfo>
Nov 10 16:32:10 user nova-compute[75102]:   <os>
Nov 10 16:32:10 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:32:10 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:32:10 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:32:10 user nova-compute[75102]:   </os>
Nov 10 16:32:10 user nova-compute[75102]:   <features>
Nov 10 16:32:10 user nova-compute[75102]:     <acpi/>
Nov 10 16:32:10 user nova-compute[75102]:     <apic/>
Nov 10 16:32:10 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:32:10 user nova-compute[75102]:   </features>
Nov 10 16:32:10 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:32:10 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:32:10 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:32:10 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:32:10 user nova-compute[75102]:   </clock>
Nov 10 16:32:10 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:32:10 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:32:10 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:32:10 user nova-compute[75102]:   </cpu>
Nov 10 16:32:10 user nova-compute[75102]:   <devices>
Nov 10 16:32:10 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:32:10 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:32:10 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk"/>
Nov 10 16:32:10 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:32:10 user nova-compute[75102]:     </disk>
Nov 10 16:32:10 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:32:10 user nova-compute[75102]:       <mac address="fa:16:3e:6e:36:9d"/>
Nov 10 16:32:10 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:32:10 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:32:10 user nova-compute[75102]:       <target dev="tap2eab767d-a5"/>
Nov 10 16:32:10 user nova-compute[75102]:     </interface>
Nov 10 16:32:10 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:32:10 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/console.log" append="off"/>
Nov 10 16:32:10 user nova-compute[75102]:     </serial>
Nov 10 16:32:10 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:32:10 user nova-compute[75102]:     <video>
Nov 10 16:32:10 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:32:10 user nova-compute[75102]:     </video>
Nov 10 16:32:10 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:32:10 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:32:10 user nova-compute[75102]:     </rng>
Nov 10 16:32:10 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:32:10 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:32:10 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:32:10 user nova-compute[75102]:     </memballoon>
Nov 10 16:32:10 user nova-compute[75102]:   </devices>
Nov 10 16:32:10 user nova-compute[75102]: </domain>
Nov 10 16:32:10 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1354456878',display_name='tempest-AttachVolumeNegativeTest-server-1354456878',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1354456878',id=31,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQrhby4GVZ1t1sxulT6PA8X7EUrkwe/hyNYueQwQicRri8w0HAdkqmjanYUQhAri6K/0gT/qpuFZ7wEqlPjbi40uc2NmJPACd6BowizWXwstwmEm+y2pQ++XzjiPR/OZA==',key_name='tempest-keypair-1619472905',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-lf7hv5rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:32:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=68e8fc6f-6d54-4804-b45c-4096f68a3894,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6e:36:9d,bridge_name='br-int',has_traffic_filtering=True,id=2eab767d-a59a-487a-9d00-839cb9f5f89a,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab767d-a5') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG os_vif [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:36:9d,bridge_name='br-int',has_traffic_filtering=True,id=2eab767d-a59a-487a-9d00-839cb9f5f89a,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab767d-a5') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '37d2b4ae-8d55-51a4-a924-184c96cd8d98', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2eab767d-a5, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2eab767d-a5, col_values=(('qos', UUID('a96dba54-3b3b-45a8-8b43-63fe18d9eae2')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2eab767d-a5, col_values=(('external_ids', {'iface-id': '2eab767d-a59a-487a-9d00-839cb9f5f89a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6e:36:9d', 'vm-uuid': '68e8fc6f-6d54-4804-b45c-4096f68a3894'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:10 user nova-compute[75102]: INFO os_vif [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6e:36:9d,bridge_name='br-int',has_traffic_filtering=True,id=2eab767d-a59a-487a-9d00-839cb9f5f89a,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab767d-a5')
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No VIF found with MAC fa:16:3e:6e:36:9d, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-fde1c41e-5b75-406a-ab9c-16444e02880a req-8ba1930e-9764-4169-bfe5-b3618896dc15 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Updated VIF entry in instance network info cache for port 2eab767d-a59a-487a-9d00-839cb9f5f89a. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-fde1c41e-5b75-406a-ab9c-16444e02880a req-8ba1930e-9764-4169-bfe5-b3618896dc15 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Updating instance_info_cache with network_info: [{"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:32:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fde1c41e-5b75-406a-ab9c-16444e02880a req-8ba1930e-9764-4169-bfe5-b3618896dc15 service nova] Releasing lock "refresh_cache-68e8fc6f-6d54-4804-b45c-4096f68a3894" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:32:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-971c4cd0-81a6-4604-84dc-74ee7de0c277 req-eb7ce8cd-f6a2-47e8-96fa-086d2fcc2830 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received event network-vif-plugged-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-971c4cd0-81a6-4604-84dc-74ee7de0c277 req-eb7ce8cd-f6a2-47e8-96fa-086d2fcc2830 service nova] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-971c4cd0-81a6-4604-84dc-74ee7de0c277 req-eb7ce8cd-f6a2-47e8-96fa-086d2fcc2830 service nova] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-971c4cd0-81a6-4604-84dc-74ee7de0c277 req-eb7ce8cd-f6a2-47e8-96fa-086d2fcc2830 service nova] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-971c4cd0-81a6-4604-84dc-74ee7de0c277 req-eb7ce8cd-f6a2-47e8-96fa-086d2fcc2830 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] No waiting events found dispatching network-vif-plugged-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:11 user nova-compute[75102]: WARNING nova.compute.manager [req-971c4cd0-81a6-4604-84dc-74ee7de0c277 req-eb7ce8cd-f6a2-47e8-96fa-086d2fcc2830 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received unexpected event network-vif-plugged-2eab767d-a59a-487a-9d00-839cb9f5f89a for instance with vm_state building and task_state spawning.
Nov 10 16:32:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 16:32:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 16:32:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:32:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:32:13 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Instance spawned successfully.
Nov 10 16:32:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-b780d501-a074-44c6-9213-0d90a1761c6c req-3d3fc45c-2a21-4932-b4cc-b78da4822e94 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received event network-vif-plugged-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b780d501-a074-44c6-9213-0d90a1761c6c req-3d3fc45c-2a21-4932-b4cc-b78da4822e94 service nova] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b780d501-a074-44c6-9213-0d90a1761c6c req-3d3fc45c-2a21-4932-b4cc-b78da4822e94 service nova] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b780d501-a074-44c6-9213-0d90a1761c6c req-3d3fc45c-2a21-4932-b4cc-b78da4822e94 service nova] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-b780d501-a074-44c6-9213-0d90a1761c6c req-3d3fc45c-2a21-4932-b4cc-b78da4822e94 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] No waiting events found dispatching network-vif-plugged-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:14 user nova-compute[75102]: WARNING nova.compute.manager [req-b780d501-a074-44c6-9213-0d90a1761c6c req-3d3fc45c-2a21-4932-b4cc-b78da4822e94 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received unexpected event network-vif-plugged-2eab767d-a59a-487a-9d00-839cb9f5f89a for instance with vm_state building and task_state spawning.
Nov 10 16:32:14 user nova-compute[75102]: INFO nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Took 5.96 seconds to spawn the instance on the hypervisor.
Nov 10 16:32:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:32:14 user nova-compute[75102]: INFO nova.compute.manager [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Took 6.85 seconds to build instance.
Nov 10 16:32:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-fec7a3ea-30a5-47ea-b28b-3756aaf39939 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.978s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPLolEnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:32:36 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:32:36 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:32:36 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b0ce617-58cc-4feb-bf03-0ccb54f4a68f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:32:36 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f982355-3d81-4916-ac88-f5bf8af3f714]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8] added
Nov 10 16:32:36 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[efc6a082-1cc2-4dba-b9e3-57615cb43ed4]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31dc4bc-b086-4da0-a783-7a58196c5f84]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPLolEnj {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v JPLolEnj" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b036794d-4589-4962-ad8a-04c27f799d99]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'JPLolEnj'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[40d57dc7-315b-4800-877e-7d613d2cb08e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dee65a9-0d3e-4b8c-a2c1-2f54d77578f6]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:32:36 user nova-compute[75102]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:32:36 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:32:36 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:32:36 user nova-compute[75102]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:32:36 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:32:36 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:32:36 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ec73529-fbd7-49d6-8ebb-aa3d26e42179]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8, portal: 172.16.0.220,3260]
Nov 10 16:32:37 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8, portal: 172.16.0.220,3260] successful.
Nov 10 16:32:37 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5879189c-2748-41b1-952e-2a30d22bb632]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a119ea8-f8a1-449d-9135-cc1d07e89f24]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:32:37 user nova-compute[75102]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:32:37 user nova-compute[75102]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)
Nov 10 16:32:37 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:32:37 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:32:37 user nova-compute[75102]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:32:37 user nova-compute[75102]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)
Nov 10 16:32:37 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:32:37 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.339s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] HCTL ('35', '-', '-', 0) found on session 29 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b595796-ba95-48d4-8977-ada85d6322d1]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Searching for a device in session 29 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:32:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPLolEnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:32:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.383s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:32:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] <== connect_volume: return (1385ms) {'type': 'block', 'scsi_wwn': '23862386231306461', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:32:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23862386231306461', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:32:38 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'flavor' on Instance uuid c34e2e7a-11a3-4718-9d67-f3eab7f21e4b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:32:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:32:38 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:32:38 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:32:38 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:32:38 user nova-compute[75102]:   <serial>a441766b-2e55-40fa-be9e-5b7d5c6aa0b8</serial>
Nov 10 16:32:38 user nova-compute[75102]: </disk>
Nov 10 16:32:38 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:32:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:32:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:32:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] No VIF found with MAC fa:16:3e:b9:84:3c, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:32:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f230b5ef-690c-4051-984c-1b03a9008da0 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 42.443s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-a5ddf9ac-21ff-4597-98bc-60746914be23 req-7d46a787-c179-4f8f-ac0e-d21cfecbeba5 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-a5ddf9ac-21ff-4597-98bc-60746914be23 req-7d46a787-c179-4f8f-ac0e-d21cfecbeba5 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing instance network info cache due to event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:32:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a5ddf9ac-21ff-4597-98bc-60746914be23 req-7d46a787-c179-4f8f-ac0e-d21cfecbeba5 service nova] Acquiring lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:32:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a5ddf9ac-21ff-4597-98bc-60746914be23 req-7d46a787-c179-4f8f-ac0e-d21cfecbeba5 service nova] Acquired lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:32:41 user nova-compute[75102]: DEBUG nova.network.neutron [req-a5ddf9ac-21ff-4597-98bc-60746914be23 req-7d46a787-c179-4f8f-ac0e-d21cfecbeba5 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:32:42 user nova-compute[75102]: DEBUG nova.network.neutron [req-a5ddf9ac-21ff-4597-98bc-60746914be23 req-7d46a787-c179-4f8f-ac0e-d21cfecbeba5 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updated VIF entry in instance network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:32:42 user nova-compute[75102]: DEBUG nova.network.neutron [req-a5ddf9ac-21ff-4597-98bc-60746914be23 req-7d46a787-c179-4f8f-ac0e-d21cfecbeba5 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updating instance_info_cache with network_info: [{"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:32:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a5ddf9ac-21ff-4597-98bc-60746914be23 req-7d46a787-c179-4f8f-ac0e-d21cfecbeba5 service nova] Releasing lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-50f0a671-c6a9-49ec-9d9c-4f82822ddfa9 req-dd048ed6-b730-495e-83bd-009095fa9c25 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-50f0a671-c6a9-49ec-9d9c-4f82822ddfa9 req-dd048ed6-b730-495e-83bd-009095fa9c25 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing instance network info cache due to event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-50f0a671-c6a9-49ec-9d9c-4f82822ddfa9 req-dd048ed6-b730-495e-83bd-009095fa9c25 service nova] Acquiring lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-50f0a671-c6a9-49ec-9d9c-4f82822ddfa9 req-dd048ed6-b730-495e-83bd-009095fa9c25 service nova] Acquired lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-50f0a671-c6a9-49ec-9d9c-4f82822ddfa9 req-dd048ed6-b730-495e-83bd-009095fa9c25 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-50f0a671-c6a9-49ec-9d9c-4f82822ddfa9 req-dd048ed6-b730-495e-83bd-009095fa9c25 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updated VIF entry in instance network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-50f0a671-c6a9-49ec-9d9c-4f82822ddfa9 req-dd048ed6-b730-495e-83bd-009095fa9c25 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updating instance_info_cache with network_info: [{"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-50f0a671-c6a9-49ec-9d9c-4f82822ddfa9 req-dd048ed6-b730-495e-83bd-009095fa9c25 service nova] Releasing lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:44 user nova-compute[75102]: INFO nova.compute.manager [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Rebooting instance
Nov 10 16:32:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquired lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:32:44 user nova-compute[75102]: DEBUG nova.network.neutron [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:32:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:45 user nova-compute[75102]: DEBUG nova.network.neutron [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updating instance_info_cache with network_info: [{"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:32:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Releasing lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:32:45 user nova-compute[75102]: DEBUG nova.compute.manager [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:32:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:48 user nova-compute[75102]: DEBUG nova.compute.manager [req-14f1de49-4df4-4ac3-a8da-1e423cd451a8 req-98e7edb7-0106-4abd-a220-b3fd4de3c229 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-unplugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-14f1de49-4df4-4ac3-a8da-1e423cd451a8 req-98e7edb7-0106-4abd-a220-b3fd4de3c229 service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-14f1de49-4df4-4ac3-a8da-1e423cd451a8 req-98e7edb7-0106-4abd-a220-b3fd4de3c229 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-14f1de49-4df4-4ac3-a8da-1e423cd451a8 req-98e7edb7-0106-4abd-a220-b3fd4de3c229 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:48 user nova-compute[75102]: DEBUG nova.compute.manager [req-14f1de49-4df4-4ac3-a8da-1e423cd451a8 req-98e7edb7-0106-4abd-a220-b3fd4de3c229 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-unplugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:48 user nova-compute[75102]: WARNING nova.compute.manager [req-14f1de49-4df4-4ac3-a8da-1e423cd451a8 req-98e7edb7-0106-4abd-a220-b3fd4de3c229 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-unplugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state active and task_state reboot_started.
Nov 10 16:32:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:48 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Instance shutdown successfully.
Nov 10 16:32:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:50 user nova-compute[75102]: WARNING nova.compute.manager [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state active and task_state reboot_started.
Nov 10 16:32:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:50 user nova-compute[75102]: WARNING nova.compute.manager [req-fcf2c928-8ea7-42da-be97-bb8414dc9c87 req-d32c7c0d-fa5f-497d-9fa0-8c84ad116a9a service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state active and task_state reboot_started.
Nov 10 16:32:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:51 user nova-compute[75102]: INFO nova.compute.manager [None req-27ac574d-ad2e-409e-a7fa-43c2dd30c296 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Unrescuing
Nov 10 16:32:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-27ac574d-ad2e-409e-a7fa-43c2dd30c296 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:32:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-27ac574d-ad2e-409e-a7fa-43c2dd30c296 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquired lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:32:51 user nova-compute[75102]: DEBUG nova.network.neutron [None req-27ac574d-ad2e-409e-a7fa-43c2dd30c296 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:32:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Instance running successfully.
Nov 10 16:32:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Instance soft rebooted successfully.
Nov 10 16:32:52 user nova-compute[75102]: DEBUG nova.compute.manager [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-65978049-88ea-4475-a30a-d9a4b3d8bec5 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.484s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-193420f8-7b43-4e36-923e-193968fee988 req-59ddf67b-4700-44d7-b185-e01f0f96a05d service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-193420f8-7b43-4e36-923e-193968fee988 req-59ddf67b-4700-44d7-b185-e01f0f96a05d service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-193420f8-7b43-4e36-923e-193968fee988 req-59ddf67b-4700-44d7-b185-e01f0f96a05d service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-193420f8-7b43-4e36-923e-193968fee988 req-59ddf67b-4700-44d7-b185-e01f0f96a05d service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-193420f8-7b43-4e36-923e-193968fee988 req-59ddf67b-4700-44d7-b185-e01f0f96a05d service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:52 user nova-compute[75102]: WARNING nova.compute.manager [req-193420f8-7b43-4e36-923e-193968fee988 req-59ddf67b-4700-44d7-b185-e01f0f96a05d service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state active and task_state None.
Nov 10 16:32:52 user nova-compute[75102]: DEBUG nova.network.neutron [None req-27ac574d-ad2e-409e-a7fa-43c2dd30c296 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Updating instance_info_cache with network_info: [{"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-27ac574d-ad2e-409e-a7fa-43c2dd30c296 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Releasing lock "refresh_cache-6c571e41-3f17-40f4-bcbc-4f3f86585d3f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG nova.objects.instance [None req-27ac574d-ad2e-409e-a7fa-43c2dd30c296 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'flavor' on Instance uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:53 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Instance destroyed successfully.
Nov 10 16:32:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-unplugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-unplugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:54 user nova-compute[75102]: WARNING nova.compute.manager [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-unplugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:32:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:54 user nova-compute[75102]: WARNING nova.compute.manager [req-9cc7aff5-1e72-4d29-a4ea-d2308cbc10d4 req-e9c6ebe9-aa08-4bac-a58e-4cc71c13ad3b service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:32:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:56 user nova-compute[75102]: WARNING nova.compute.manager [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:32:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:32:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:32:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:32:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:32:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:32:56 user nova-compute[75102]: WARNING nova.compute.manager [req-449f856c-93ee-477f-bda3-59a35c9c26ef req-9d3dd4ae-0493-4a2a-b1e5-2c18d8fdd360 service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:32:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:32:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-27ac574d-ad2e-409e-a7fa-43c2dd30c296 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:32:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:59 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:32:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid b0b033f4-4325-4d53-bd0d-1c90bbfa54cc {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid c34e2e7a-11a3-4718-9d67-f3eab7f21e4b {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid ec4a2e9d-de37-4e9b-840f-9c112f1b0789 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 68e8fc6f-6d54-4804-b45c-4096f68a3894 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 22865b86-3ce3-4ec7-89c4-fc08684a0a60 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.078s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.081s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.080s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.089s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.114s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.116s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.121s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:01 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:33:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:01 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:33:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.265s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:33:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.282s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.269s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.313s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.307s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:33:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.351s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.311s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.274s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.308s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:33:06 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:33:06 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7811MB free_disk=24.962047576904297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6c571e41-3f17-40f4-bcbc-4f3f86585d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance ec4a2e9d-de37-4e9b-840f-9c112f1b0789 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 68e8fc6f-6d54-4804-b45c-4096f68a3894 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:33:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:33:07 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:33:07 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:33:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:33:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.859s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:33:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:33:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:33:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:33:08 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updating instance_info_cache with network_info: [{"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:33:09 user nova-compute[75102]: INFO nova.compute.claims [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Claim successful on node user
Nov 10 16:33:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.538s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:33:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:33:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG nova.policy [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6ef288da57b4a26b32fd2d368fa85a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221beb548fbb455ca011f3a3fc7c4d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:33:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Creating image(s)
Nov 10 16:33:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "/opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "/opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "/opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.250s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.222s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Successfully created port: 0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk 1073741824" returned: 0 in 0.060s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.217s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Cannot resize image /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Ensure instance console log exists: /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Successfully updated port: 0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquired lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:33:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-9be6e185-cfc2-49d3-95a3-579488d13425 req-16771628-b899-4be1-b77b-1e34a1f67f55 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received event network-changed-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-9be6e185-cfc2-49d3-95a3-579488d13425 req-16771628-b899-4be1-b77b-1e34a1f67f55 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Refreshing instance network info cache due to event network-changed-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9be6e185-cfc2-49d3-95a3-579488d13425 req-16771628-b899-4be1-b77b-1e34a1f67f55 service nova] Acquiring lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Updating instance_info_cache with network_info: [{"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Releasing lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Instance network_info: |[{"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9be6e185-cfc2-49d3-95a3-579488d13425 req-16771628-b899-4be1-b77b-1e34a1f67f55 service nova] Acquired lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-9be6e185-cfc2-49d3-95a3-579488d13425 req-16771628-b899-4be1-b77b-1e34a1f67f55 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Refreshing network info cache for port 0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Start _get_guest_xml network_info=[{"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:33:12 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:33:12 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1923502921',display_name='tempest-ServersNegativeTestJSON-server-1923502921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1923502921',id=32,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='221beb548fbb455ca011f3a3fc7c4d34',ramdisk_id='',reservation_id='r-8dsmxdnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1842056783',owner_user_name='tempest-ServersNegativeTestJSON-1842056783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:33:11Z,user_data=None,user_id='a6ef288da57b4a26b32fd2d368fa85a6',uuid=4ac04f9f-f403-4204-a3d0-1c9e0c4ca442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converting VIF {"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:42,bridge_name='br-int',has_traffic_filtering=True,id=0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f9fbe75-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.objects.instance [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lazy-loading 'pci_devices' on Instance uuid 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:33:12 user nova-compute[75102]:   <uuid>4ac04f9f-f403-4204-a3d0-1c9e0c4ca442</uuid>
Nov 10 16:33:12 user nova-compute[75102]:   <name>instance-00000020</name>
Nov 10 16:33:12 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:33:12 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:33:12 user nova-compute[75102]:   <metadata>
Nov 10 16:33:12 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:33:12 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:33:12 user nova-compute[75102]:       <nova:name>tempest-ServersNegativeTestJSON-server-1923502921</nova:name>
Nov 10 16:33:12 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:33:12</nova:creationTime>
Nov 10 16:33:12 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:33:12 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:33:12 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:33:12 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:33:12 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:33:12 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:33:12 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:33:12 user nova-compute[75102]:       <nova:owner>
Nov 10 16:33:12 user nova-compute[75102]:         <nova:user uuid="a6ef288da57b4a26b32fd2d368fa85a6">tempest-ServersNegativeTestJSON-1842056783-project-member</nova:user>
Nov 10 16:33:12 user nova-compute[75102]:         <nova:project uuid="221beb548fbb455ca011f3a3fc7c4d34">tempest-ServersNegativeTestJSON-1842056783</nova:project>
Nov 10 16:33:12 user nova-compute[75102]:       </nova:owner>
Nov 10 16:33:12 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:33:12 user nova-compute[75102]:       <nova:ports>
Nov 10 16:33:12 user nova-compute[75102]:         <nova:port uuid="0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11">
Nov 10 16:33:12 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 10 16:33:12 user nova-compute[75102]:         </nova:port>
Nov 10 16:33:12 user nova-compute[75102]:       </nova:ports>
Nov 10 16:33:12 user nova-compute[75102]:     </nova:instance>
Nov 10 16:33:12 user nova-compute[75102]:   </metadata>
Nov 10 16:33:12 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:33:12 user nova-compute[75102]:     <system>
Nov 10 16:33:12 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:33:12 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:33:12 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:33:12 user nova-compute[75102]:       <entry name="serial">4ac04f9f-f403-4204-a3d0-1c9e0c4ca442</entry>
Nov 10 16:33:12 user nova-compute[75102]:       <entry name="uuid">4ac04f9f-f403-4204-a3d0-1c9e0c4ca442</entry>
Nov 10 16:33:12 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:33:12 user nova-compute[75102]:     </system>
Nov 10 16:33:12 user nova-compute[75102]:   </sysinfo>
Nov 10 16:33:12 user nova-compute[75102]:   <os>
Nov 10 16:33:12 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:33:12 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:33:12 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:33:12 user nova-compute[75102]:   </os>
Nov 10 16:33:12 user nova-compute[75102]:   <features>
Nov 10 16:33:12 user nova-compute[75102]:     <acpi/>
Nov 10 16:33:12 user nova-compute[75102]:     <apic/>
Nov 10 16:33:12 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:33:12 user nova-compute[75102]:   </features>
Nov 10 16:33:12 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:33:12 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:33:12 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:33:12 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:33:12 user nova-compute[75102]:   </clock>
Nov 10 16:33:12 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:33:12 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:33:12 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:33:12 user nova-compute[75102]:   </cpu>
Nov 10 16:33:12 user nova-compute[75102]:   <devices>
Nov 10 16:33:12 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:33:12 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:33:12 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk"/>
Nov 10 16:33:12 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:33:12 user nova-compute[75102]:     </disk>
Nov 10 16:33:12 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:33:12 user nova-compute[75102]:       <mac address="fa:16:3e:c2:11:42"/>
Nov 10 16:33:12 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:33:12 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:33:12 user nova-compute[75102]:       <target dev="tap0f9fbe75-ca"/>
Nov 10 16:33:12 user nova-compute[75102]:     </interface>
Nov 10 16:33:12 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:33:12 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/console.log" append="off"/>
Nov 10 16:33:12 user nova-compute[75102]:     </serial>
Nov 10 16:33:12 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:33:12 user nova-compute[75102]:     <video>
Nov 10 16:33:12 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:33:12 user nova-compute[75102]:     </video>
Nov 10 16:33:12 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:33:12 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:33:12 user nova-compute[75102]:     </rng>
Nov 10 16:33:12 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:33:12 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:33:12 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:33:12 user nova-compute[75102]:     </memballoon>
Nov 10 16:33:12 user nova-compute[75102]:   </devices>
Nov 10 16:33:12 user nova-compute[75102]: </domain>
Nov 10 16:33:12 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1923502921',display_name='tempest-ServersNegativeTestJSON-server-1923502921',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1923502921',id=32,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='221beb548fbb455ca011f3a3fc7c4d34',ramdisk_id='',reservation_id='r-8dsmxdnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1842056783',owner_user_name='tempest-ServersNegativeTestJSON-1842056783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:33:11Z,user_data=None,user_id='a6ef288da57b4a26b32fd2d368fa85a6',uuid=4ac04f9f-f403-4204-a3d0-1c9e0c4ca442,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converting VIF {"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:42,bridge_name='br-int',has_traffic_filtering=True,id=0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f9fbe75-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG os_vif [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:42,bridge_name='br-int',has_traffic_filtering=True,id=0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f9fbe75-ca') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '46cd9a5b-b237-5f88-833e-42fe42fce14f', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f9fbe75-ca, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f9fbe75-ca, col_values=(('qos', UUID('99946a25-4fc3-4cbd-b34d-598ff117bdea')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f9fbe75-ca, col_values=(('external_ids', {'iface-id': '0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:11:42', 'vm-uuid': '4ac04f9f-f403-4204-a3d0-1c9e0c4ca442'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:12 user nova-compute[75102]: INFO os_vif [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:11:42,bridge_name='br-int',has_traffic_filtering=True,id=0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f9fbe75-ca')
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:33:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] No VIF found with MAC fa:16:3e:c2:11:42, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:33:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-9be6e185-cfc2-49d3-95a3-579488d13425 req-16771628-b899-4be1-b77b-1e34a1f67f55 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Updated VIF entry in instance network info cache for port 0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:33:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-9be6e185-cfc2-49d3-95a3-579488d13425 req-16771628-b899-4be1-b77b-1e34a1f67f55 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Updating instance_info_cache with network_info: [{"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:33:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9be6e185-cfc2-49d3-95a3-579488d13425 req-16771628-b899-4be1-b77b-1e34a1f67f55 service nova] Releasing lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-9e72458a-a58d-4ede-80a9-6d1ec5b29cc8 req-4fd6977f-50a3-4e2a-8630-cd45756d39f1 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received event network-vif-plugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9e72458a-a58d-4ede-80a9-6d1ec5b29cc8 req-4fd6977f-50a3-4e2a-8630-cd45756d39f1 service nova] Acquiring lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9e72458a-a58d-4ede-80a9-6d1ec5b29cc8 req-4fd6977f-50a3-4e2a-8630-cd45756d39f1 service nova] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9e72458a-a58d-4ede-80a9-6d1ec5b29cc8 req-4fd6977f-50a3-4e2a-8630-cd45756d39f1 service nova] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-9e72458a-a58d-4ede-80a9-6d1ec5b29cc8 req-4fd6977f-50a3-4e2a-8630-cd45756d39f1 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] No waiting events found dispatching network-vif-plugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:33:14 user nova-compute[75102]: WARNING nova.compute.manager [req-9e72458a-a58d-4ede-80a9-6d1ec5b29cc8 req-4fd6977f-50a3-4e2a-8630-cd45756d39f1 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received unexpected event network-vif-plugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 for instance with vm_state building and task_state spawning.
Nov 10 16:33:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquiring lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquiring lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:15 user nova-compute[75102]: INFO nova.compute.manager [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Terminating instance
Nov 10 16:33:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Instance destroyed successfully.
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.objects.instance [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lazy-loading 'resources' on Instance uuid ec4a2e9d-de37-4e9b-840f-9c112f1b0789 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:31:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1513902143',display_name='tempest-VolumesActionsTest-instance-1513902143',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1513902143',id=30,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:31:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a2985007d7c04c68880c89199595e184',ramdisk_id='',reservation_id='r-tp1sh5cz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-2111151066',owner_user_name='tempest-VolumesActionsTest-2111151066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:31:15Z,user_data=None,user_id='0a9eddb7927d4fa2bfd2cce4f2697753',uuid=ec4a2e9d-de37-4e9b-840f-9c112f1b0789,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Converting VIF {"id": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "address": "fa:16:3e:a2:ac:a6", "network": {"id": "af7fec63-3384-4cd0-a802-77f9fa3310c3", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1794100248-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a2985007d7c04c68880c89199595e184", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap91197a85-92", "ovs_interfaceid": "91197a85-92dc-43d1-b9dc-3e8c37e583fe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a6,bridge_name='br-int',has_traffic_filtering=True,id=91197a85-92dc-43d1-b9dc-3e8c37e583fe,network=Network(af7fec63-3384-4cd0-a802-77f9fa3310c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91197a85-92') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG os_vif [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a6,bridge_name='br-int',has_traffic_filtering=True,id=91197a85-92dc-43d1-b9dc-3e8c37e583fe,network=Network(af7fec63-3384-4cd0-a802-77f9fa3310c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91197a85-92') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap91197a85-92, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f14b0be4-9075-4c44-9541-025cb08c0f05) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:16 user nova-compute[75102]: INFO os_vif [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a2:ac:a6,bridge_name='br-int',has_traffic_filtering=True,id=91197a85-92dc-43d1-b9dc-3e8c37e583fe,network=Network(af7fec63-3384-4cd0-a802-77f9fa3310c3),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91197a85-92')
Nov 10 16:33:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Deleting instance files /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789_del
Nov 10 16:33:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Deletion of /opt/stack/data/nova/instances/ec4a2e9d-de37-4e9b-840f-9c112f1b0789_del complete
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:33:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Instance spawned successfully.
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received event network-vif-plugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] Acquiring lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] No waiting events found dispatching network-vif-plugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:33:16 user nova-compute[75102]: WARNING nova.compute.manager [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received unexpected event network-vif-plugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 for instance with vm_state building and task_state spawning.
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received event network-vif-unplugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] Acquiring lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] No waiting events found dispatching network-vif-unplugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received event network-vif-unplugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received event network-vif-plugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] Acquiring lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] No waiting events found dispatching network-vif-plugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:33:16 user nova-compute[75102]: WARNING nova.compute.manager [req-1332c089-1045-43b7-ae95-64e32f22dde5 req-fb0fbd77-009f-44f9-990f-daba1cdb6141 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received unexpected event network-vif-plugged-91197a85-92dc-43d1-b9dc-3e8c37e583fe for instance with vm_state active and task_state deleting.
Nov 10 16:33:16 user nova-compute[75102]: INFO nova.compute.manager [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:33:16 user nova-compute[75102]: INFO nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Took 6.05 seconds to spawn the instance on the hypervisor.
Nov 10 16:33:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:33:16 user nova-compute[75102]: INFO nova.compute.manager [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Took 7.03 seconds to build instance.
Nov 10 16:33:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-69b6f24f-fb64-48ef-8b69-7afb9e0ace60 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.146s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:17 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:33:17 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Took 0.76 seconds to deallocate network for instance.
Nov 10 16:33:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-30b84970-e96d-4183-901e-f65736e60f56 req-98b77fec-d107-453d-abfd-61616b04ea75 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Received event network-vif-deleted-91197a85-92dc-43d1-b9dc-3e8c37e583fe {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:17 user nova-compute[75102]: INFO nova.compute.manager [req-30b84970-e96d-4183-901e-f65736e60f56 req-98b77fec-d107-453d-abfd-61616b04ea75 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Neutron deleted interface 91197a85-92dc-43d1-b9dc-3e8c37e583fe; detaching it from the instance and deleting it from the info cache
Nov 10 16:33:17 user nova-compute[75102]: DEBUG nova.network.neutron [req-30b84970-e96d-4183-901e-f65736e60f56 req-98b77fec-d107-453d-abfd-61616b04ea75 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:33:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-30b84970-e96d-4183-901e-f65736e60f56 req-98b77fec-d107-453d-abfd-61616b04ea75 service nova] [instance: ec4a2e9d-de37-4e9b-840f-9c112f1b0789] Detach interface failed, port_id=91197a85-92dc-43d1-b9dc-3e8c37e583fe, reason: Instance ec4a2e9d-de37-4e9b-840f-9c112f1b0789 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:33:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:17 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:33:17 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:33:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.477s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:18 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Deleted allocations for instance ec4a2e9d-de37-4e9b-840f-9c112f1b0789
Nov 10 16:33:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-abaee94d-f476-4cf5-abc3-9352240239f3 tempest-VolumesActionsTest-2111151066 tempest-VolumesActionsTest-2111151066-project-member] Lock "ec4a2e9d-de37-4e9b-840f-9c112f1b0789" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.413s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:33:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:42 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:33:42 user nova-compute[75102]: INFO nova.compute.claims [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Claim successful on node user
Nov 10 16:33:43 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.595s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG nova.network.neutron [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:33:43 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:33:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG nova.policy [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6794c1f412bb4fe1a9199c54acaf0f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6dc60461b8e4239934a4dbba48519a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:33:43 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Creating image(s)
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "/opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "/opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk 1073741824" returned: 0 in 0.155s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.360s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.231s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG nova.network.neutron [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Successfully created port: 85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Cannot resize image /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Ensure instance console log exists: /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.neutron [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Successfully updated port: 85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquired lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.neutron [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-a86d4e39-4e60-4e6e-afe0-97b89f91b40b req-f6b962db-7fd0-4571-b79a-1dfdd4a7821b service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received event network-changed-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-a86d4e39-4e60-4e6e-afe0-97b89f91b40b req-f6b962db-7fd0-4571-b79a-1dfdd4a7821b service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Refreshing instance network info cache due to event network-changed-85633d7f-63c9-46e3-aedf-1d5252041c10. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a86d4e39-4e60-4e6e-afe0-97b89f91b40b req-f6b962db-7fd0-4571-b79a-1dfdd4a7821b service nova] Acquiring lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.neutron [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.neutron [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updating instance_info_cache with network_info: [{"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Releasing lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Instance network_info: |[{"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a86d4e39-4e60-4e6e-afe0-97b89f91b40b req-f6b962db-7fd0-4571-b79a-1dfdd4a7821b service nova] Acquired lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.neutron [req-a86d4e39-4e60-4e6e-afe0-97b89f91b40b req-f6b962db-7fd0-4571-b79a-1dfdd4a7821b service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Refreshing network info cache for port 85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Start _get_guest_xml network_info=[{"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:33:45 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:33:45 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1070046215',display_name='tempest-TestStampPattern-server-1070046215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1070046215',id=33,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ8+LDBaM3IFKtZWt/WbN0wsXWTN3yBtKNBzWRh29A/ZPbyZyZTEWW+5+UGKfbdFjdDFqTq7gGbWdQpAbPZvSUbk8/mRUGgNL2pcc13I3ZIpl4yxUxyJFPJSb5GfPis2w==',key_name='tempest-TestStampPattern-81644141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6dc60461b8e4239934a4dbba48519a7',ramdisk_id='',reservation_id='r-713kxs3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-314715126',owner_user_name='tempest-TestStampPattern-314715126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:33:43Z,user_data=None,user_id='6794c1f412bb4fe1a9199c54acaf0f69',uuid=c9348a9d-5891-40f6-96c7-e8c7179cf315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converting VIF {"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:78:6b,bridge_name='br-int',has_traffic_filtering=True,id=85633d7f-63c9-46e3-aedf-1d5252041c10,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85633d7f-63') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.objects.instance [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lazy-loading 'pci_devices' on Instance uuid c9348a9d-5891-40f6-96c7-e8c7179cf315 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:33:45 user nova-compute[75102]:   <uuid>c9348a9d-5891-40f6-96c7-e8c7179cf315</uuid>
Nov 10 16:33:45 user nova-compute[75102]:   <name>instance-00000021</name>
Nov 10 16:33:45 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:33:45 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:33:45 user nova-compute[75102]:   <metadata>
Nov 10 16:33:45 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:33:45 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:33:45 user nova-compute[75102]:       <nova:name>tempest-TestStampPattern-server-1070046215</nova:name>
Nov 10 16:33:45 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:33:45</nova:creationTime>
Nov 10 16:33:45 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:33:45 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:33:45 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:33:45 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:33:45 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:33:45 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:33:45 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:33:45 user nova-compute[75102]:       <nova:owner>
Nov 10 16:33:45 user nova-compute[75102]:         <nova:user uuid="6794c1f412bb4fe1a9199c54acaf0f69">tempest-TestStampPattern-314715126-project-member</nova:user>
Nov 10 16:33:45 user nova-compute[75102]:         <nova:project uuid="b6dc60461b8e4239934a4dbba48519a7">tempest-TestStampPattern-314715126</nova:project>
Nov 10 16:33:45 user nova-compute[75102]:       </nova:owner>
Nov 10 16:33:45 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:33:45 user nova-compute[75102]:       <nova:ports>
Nov 10 16:33:45 user nova-compute[75102]:         <nova:port uuid="85633d7f-63c9-46e3-aedf-1d5252041c10">
Nov 10 16:33:45 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 10 16:33:45 user nova-compute[75102]:         </nova:port>
Nov 10 16:33:45 user nova-compute[75102]:       </nova:ports>
Nov 10 16:33:45 user nova-compute[75102]:     </nova:instance>
Nov 10 16:33:45 user nova-compute[75102]:   </metadata>
Nov 10 16:33:45 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:33:45 user nova-compute[75102]:     <system>
Nov 10 16:33:45 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:33:45 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:33:45 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:33:45 user nova-compute[75102]:       <entry name="serial">c9348a9d-5891-40f6-96c7-e8c7179cf315</entry>
Nov 10 16:33:45 user nova-compute[75102]:       <entry name="uuid">c9348a9d-5891-40f6-96c7-e8c7179cf315</entry>
Nov 10 16:33:45 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:33:45 user nova-compute[75102]:     </system>
Nov 10 16:33:45 user nova-compute[75102]:   </sysinfo>
Nov 10 16:33:45 user nova-compute[75102]:   <os>
Nov 10 16:33:45 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:33:45 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:33:45 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:33:45 user nova-compute[75102]:   </os>
Nov 10 16:33:45 user nova-compute[75102]:   <features>
Nov 10 16:33:45 user nova-compute[75102]:     <acpi/>
Nov 10 16:33:45 user nova-compute[75102]:     <apic/>
Nov 10 16:33:45 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:33:45 user nova-compute[75102]:   </features>
Nov 10 16:33:45 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:33:45 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:33:45 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:33:45 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:33:45 user nova-compute[75102]:   </clock>
Nov 10 16:33:45 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:33:45 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:33:45 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:33:45 user nova-compute[75102]:   </cpu>
Nov 10 16:33:45 user nova-compute[75102]:   <devices>
Nov 10 16:33:45 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:33:45 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:33:45 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk"/>
Nov 10 16:33:45 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:33:45 user nova-compute[75102]:     </disk>
Nov 10 16:33:45 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:33:45 user nova-compute[75102]:       <mac address="fa:16:3e:9e:78:6b"/>
Nov 10 16:33:45 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:33:45 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:33:45 user nova-compute[75102]:       <target dev="tap85633d7f-63"/>
Nov 10 16:33:45 user nova-compute[75102]:     </interface>
Nov 10 16:33:45 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:33:45 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/console.log" append="off"/>
Nov 10 16:33:45 user nova-compute[75102]:     </serial>
Nov 10 16:33:45 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:33:45 user nova-compute[75102]:     <video>
Nov 10 16:33:45 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:33:45 user nova-compute[75102]:     </video>
Nov 10 16:33:45 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:33:45 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:33:45 user nova-compute[75102]:     </rng>
Nov 10 16:33:45 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:33:45 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:33:45 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:33:45 user nova-compute[75102]:     </memballoon>
Nov 10 16:33:45 user nova-compute[75102]:   </devices>
Nov 10 16:33:45 user nova-compute[75102]: </domain>
Nov 10 16:33:45 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1070046215',display_name='tempest-TestStampPattern-server-1070046215',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1070046215',id=33,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ8+LDBaM3IFKtZWt/WbN0wsXWTN3yBtKNBzWRh29A/ZPbyZyZTEWW+5+UGKfbdFjdDFqTq7gGbWdQpAbPZvSUbk8/mRUGgNL2pcc13I3ZIpl4yxUxyJFPJSb5GfPis2w==',key_name='tempest-TestStampPattern-81644141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6dc60461b8e4239934a4dbba48519a7',ramdisk_id='',reservation_id='r-713kxs3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-314715126',owner_user_name='tempest-TestStampPattern-314715126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:33:43Z,user_data=None,user_id='6794c1f412bb4fe1a9199c54acaf0f69',uuid=c9348a9d-5891-40f6-96c7-e8c7179cf315,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converting VIF {"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:78:6b,bridge_name='br-int',has_traffic_filtering=True,id=85633d7f-63c9-46e3-aedf-1d5252041c10,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85633d7f-63') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG os_vif [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:78:6b,bridge_name='br-int',has_traffic_filtering=True,id=85633d7f-63c9-46e3-aedf-1d5252041c10,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85633d7f-63') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6345ca6d-4b6c-557a-8782-c3e1ac47b1ca', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85633d7f-63, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85633d7f-63, col_values=(('qos', UUID('10370d68-35d8-43e1-9df5-41069a3bf90c')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85633d7f-63, col_values=(('external_ids', {'iface-id': '85633d7f-63c9-46e3-aedf-1d5252041c10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:78:6b', 'vm-uuid': 'c9348a9d-5891-40f6-96c7-e8c7179cf315'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:45 user nova-compute[75102]: INFO os_vif [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:78:6b,bridge_name='br-int',has_traffic_filtering=True,id=85633d7f-63c9-46e3-aedf-1d5252041c10,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85633d7f-63')
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] No VIF found with MAC fa:16:3e:9e:78:6b, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.neutron [req-a86d4e39-4e60-4e6e-afe0-97b89f91b40b req-f6b962db-7fd0-4571-b79a-1dfdd4a7821b service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updated VIF entry in instance network info cache for port 85633d7f-63c9-46e3-aedf-1d5252041c10. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG nova.network.neutron [req-a86d4e39-4e60-4e6e-afe0-97b89f91b40b req-f6b962db-7fd0-4571-b79a-1dfdd4a7821b service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updating instance_info_cache with network_info: [{"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:33:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a86d4e39-4e60-4e6e-afe0-97b89f91b40b req-f6b962db-7fd0-4571-b79a-1dfdd4a7821b service nova] Releasing lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:33:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:47 user nova-compute[75102]: DEBUG nova.compute.manager [req-eaaeb68b-c414-45ee-869c-e632b4836ce2 req-f45a5962-18ec-401f-a40e-baeeb7c3235e service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received event network-vif-plugged-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eaaeb68b-c414-45ee-869c-e632b4836ce2 req-f45a5962-18ec-401f-a40e-baeeb7c3235e service nova] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eaaeb68b-c414-45ee-869c-e632b4836ce2 req-f45a5962-18ec-401f-a40e-baeeb7c3235e service nova] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eaaeb68b-c414-45ee-869c-e632b4836ce2 req-f45a5962-18ec-401f-a40e-baeeb7c3235e service nova] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:47 user nova-compute[75102]: DEBUG nova.compute.manager [req-eaaeb68b-c414-45ee-869c-e632b4836ce2 req-f45a5962-18ec-401f-a40e-baeeb7c3235e service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] No waiting events found dispatching network-vif-plugged-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:33:47 user nova-compute[75102]: WARNING nova.compute.manager [req-eaaeb68b-c414-45ee-869c-e632b4836ce2 req-f45a5962-18ec-401f-a40e-baeeb7c3235e service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received unexpected event network-vif-plugged-85633d7f-63c9-46e3-aedf-1d5252041c10 for instance with vm_state building and task_state spawning.
Nov 10 16:33:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:33:49 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Instance spawned successfully.
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-b0125486-4fd3-4140-a64a-fde4a921534d req-3d68fd53-568b-4b93-acda-429262c4660d service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received event network-vif-plugged-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b0125486-4fd3-4140-a64a-fde4a921534d req-3d68fd53-568b-4b93-acda-429262c4660d service nova] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b0125486-4fd3-4140-a64a-fde4a921534d req-3d68fd53-568b-4b93-acda-429262c4660d service nova] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b0125486-4fd3-4140-a64a-fde4a921534d req-3d68fd53-568b-4b93-acda-429262c4660d service nova] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-b0125486-4fd3-4140-a64a-fde4a921534d req-3d68fd53-568b-4b93-acda-429262c4660d service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] No waiting events found dispatching network-vif-plugged-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:33:49 user nova-compute[75102]: WARNING nova.compute.manager [req-b0125486-4fd3-4140-a64a-fde4a921534d req-3d68fd53-568b-4b93-acda-429262c4660d service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received unexpected event network-vif-plugged-85633d7f-63c9-46e3-aedf-1d5252041c10 for instance with vm_state building and task_state spawning.
Nov 10 16:33:49 user nova-compute[75102]: INFO nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Took 5.86 seconds to spawn the instance on the hypervisor.
Nov 10 16:33:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:33:49 user nova-compute[75102]: INFO nova.compute.manager [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Took 6.82 seconds to build instance.
Nov 10 16:33:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-32b0ac66-cfca-4d8a-bf03-148359191d93 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.931s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:33:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:33:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-aa0df3c7-c9f4-40e4-b0ce-32437e3ad8ff req-7af3d0d7-ea15-4a9d-bfbc-2ff01e04a0c2 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received event network-changed-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:33:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-aa0df3c7-c9f4-40e4-b0ce-32437e3ad8ff req-7af3d0d7-ea15-4a9d-bfbc-2ff01e04a0c2 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Refreshing instance network info cache due to event network-changed-2eab767d-a59a-487a-9d00-839cb9f5f89a. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:33:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-aa0df3c7-c9f4-40e4-b0ce-32437e3ad8ff req-7af3d0d7-ea15-4a9d-bfbc-2ff01e04a0c2 service nova] Acquiring lock "refresh_cache-68e8fc6f-6d54-4804-b45c-4096f68a3894" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:33:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-aa0df3c7-c9f4-40e4-b0ce-32437e3ad8ff req-7af3d0d7-ea15-4a9d-bfbc-2ff01e04a0c2 service nova] Acquired lock "refresh_cache-68e8fc6f-6d54-4804-b45c-4096f68a3894" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:33:58 user nova-compute[75102]: DEBUG nova.network.neutron [req-aa0df3c7-c9f4-40e4-b0ce-32437e3ad8ff req-7af3d0d7-ea15-4a9d-bfbc-2ff01e04a0c2 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Refreshing network info cache for port 2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:33:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:33:59 user nova-compute[75102]: DEBUG nova.network.neutron [req-aa0df3c7-c9f4-40e4-b0ce-32437e3ad8ff req-7af3d0d7-ea15-4a9d-bfbc-2ff01e04a0c2 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Updated VIF entry in instance network info cache for port 2eab767d-a59a-487a-9d00-839cb9f5f89a. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:33:59 user nova-compute[75102]: DEBUG nova.network.neutron [req-aa0df3c7-c9f4-40e4-b0ce-32437e3ad8ff req-7af3d0d7-ea15-4a9d-bfbc-2ff01e04a0c2 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Updating instance_info_cache with network_info: [{"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:33:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-aa0df3c7-c9f4-40e4-b0ce-32437e3ad8ff req-7af3d0d7-ea15-4a9d-bfbc-2ff01e04a0c2 service nova] Releasing lock "refresh_cache-68e8fc6f-6d54-4804-b45c-4096f68a3894" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:33:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:33:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:00 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:01 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:01 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:02 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:03 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:34:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.219s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG nova.objects.instance [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'flavor' on Instance uuid 68e8fc6f-6d54-4804-b45c-4096f68a3894 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60/disk --force-share --output=json" returned: 0 in 0.243s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:04 user nova-compute[75102]: INFO nova.compute.manager [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Attaching volume 3dd424ad-874a-4243-8f17-172d9052951c to /dev/vdb
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG os_brick.utils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b97ffb-e2d9-46ba-8c0d-067bbef344ae]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c0ef719-66cb-4ac0-b812-758f44431468]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5deaeb39-f206-42a0-b2e6-ff1c6c509b4c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[881c15d2-d01c-4ac0-8916-8ac3ae02b01f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:34:04 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:34:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2222b50d-1ee2-4142-a78b-c835fe84af10]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG os_brick.utils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] <== get_connector_properties: return (174ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:34:04 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Updating existing volume attachment record: 14c966e7-1354-4c5b-9050-4397c2f62d7d {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.233s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.287s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:34:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:34:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7505MB free_disk=24.92176055908203GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 6c571e41-3f17-40f4-bcbc-4f3f86585d3f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 68e8fc6f-6d54-4804-b45c-4096f68a3894 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:34:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:34:08 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:34:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:34:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:34:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.569s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:34:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 16:34:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:34:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:10 user nova-compute[75102]: INFO nova.compute.manager [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Detaching volume eec57ecc-343d-493d-8d69-2a8f3752e72d
Nov 10 16:34:11 user nova-compute[75102]: INFO nova.virt.block_device [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Attempting to driver detach volume eec57ecc-343d-493d-8d69-2a8f3752e72d from mountpoint /dev/vdb
Nov 10 16:34:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Attempting to detach device vdb from instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:34:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:34:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:34:11 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:34:11 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:34:11 user nova-compute[75102]:   <serial>eec57ecc-343d-493d-8d69-2a8f3752e72d</serial>
Nov 10 16:34:11 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 16:34:11 user nova-compute[75102]: </disk>
Nov 10 16:34:11 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:34:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully detached device vdb from instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 from the persistent domain config.
Nov 10 16:34:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:34:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:34:11 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:34:11 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:34:11 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:34:11 user nova-compute[75102]:   <serial>eec57ecc-343d-493d-8d69-2a8f3752e72d</serial>
Nov 10 16:34:11 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 10 16:34:11 user nova-compute[75102]: </disk>
Nov 10 16:34:11 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:34:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:34:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:34:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:31 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 is timed out.
Nov 10 16:34:31 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully detached device vdb from instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 from the live domain config.
Nov 10 16:34:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gPEwNJsM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:34:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb59cbcc-5bf9-4e39-b1ad-5bb8d711775a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:34:31 user nova-compute[75102]: No targets found.
Nov 10 16:34:31 user nova-compute[75102]: iSNS:
Nov 10 16:34:31 user nova-compute[75102]: No targets found.
Nov 10 16:34:31 user nova-compute[75102]: STATIC:
Nov 10 16:34:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62
Nov 10 16:34:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:34:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:34:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d
Nov 10 16:34:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:34:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:34:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:34:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:34:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:34:31 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8
Nov 10 16:34:31 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:34:31 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:34:31 user nova-compute[75102]: FIRMWARE:
Nov 10 16:34:31 user nova-compute[75102]: No targets found.
Nov 10 16:34:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:34:31 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:34:31 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[980037d1-831b-437b-8d10-e05883c92403]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[432cf7fc-97df-421e-98ce-1c99b8ee8bae]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:34:31 user nova-compute[75102]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:34:31 user nova-compute[75102]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)
Nov 10 16:34:31 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:34:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:34:31 user nova-compute[75102]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d (non-flash)
Nov 10 16:34:31 user nova-compute[75102]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)
Nov 10 16:34:31 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:34:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7473f520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a43a1f08-21a9-4adb-8e8f-71cc7500b6b8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[594944a7-96cb-4bda-9f2b-b0de3bf1d893]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a34790b4-1831-47cb-ad2e-f59a8b74a2ad]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e99791d6-b078-43ad-a6e2-6cc412d7bead]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[de79613d-14c2-4fb5-bc8d-c4b79c7d88ab]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3207b378-6031-4ab9-974d-eeb522245561]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260]
Nov 10 16:34:31 user nova-compute[75102]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d, portal: 172.16.0.220,3260] successful.
Nov 10 16:34:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:eec57ecc-343d-493d-8d69-2a8f3752e72d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7c5797a-9eec-44b6-8fe7-e1f103f23fc7]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== disconnect_volume: return (321ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:34:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:34:32 user nova-compute[75102]: DEBUG nova.objects.instance [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'flavor' on Instance uuid 22865b86-3ce3-4ec7-89c4-fc08684a0a60 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:34:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-58574809-cf56-4043-8a52-bd237ebe4373 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.049s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.volume.cinder [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Update attachment failed for attachment 14c966e7-1354-4c5b-9050-4397c2f62d7d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-15441940-3836-4abe-9ded-3c1d866219f7) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-15441940-3836-4abe-9ded-3c1d866219f7)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Failed to attach 3dd424ad-874a-4243-8f17-172d9052951c at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-15441940-3836-4abe-9ded-3c1d866219f7)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Traceback (most recent call last):
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     self._volume_attach(context, volume, connector, instance,
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     connection_info = volume_api.attachment_update(
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     res = method(self, ctx, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     with excutils.save_and_reraise_exception():
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     self.force_reraise()
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     raise self.value
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     return method.func(obj, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     return self.request(url, method, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894]     raise exceptions.from_response(resp, body)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-15441940-3836-4abe-9ded-3c1d866219f7)
Nov 10 16:34:33 user nova-compute[75102]: ERROR nova.compute.manager [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] 
Nov 10 16:34:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.855s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server [None req-80f9ecf1-9a31-454d-83bc-c0b8f86abbe6 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-15441940-3836-4abe-9ded-3c1d866219f7)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-15441940-3836-4abe-9ded-3c1d866219f7)
Nov 10 16:34:33 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:34:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:34:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-152962ec-c7f0-4b0b-9ab8-2114c8d8ecef req-131854eb-c08a-4aa3-ac5b-ab76a8d5b47c service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:34:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-152962ec-c7f0-4b0b-9ab8-2114c8d8ecef req-131854eb-c08a-4aa3-ac5b-ab76a8d5b47c service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing instance network info cache due to event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:34:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-152962ec-c7f0-4b0b-9ab8-2114c8d8ecef req-131854eb-c08a-4aa3-ac5b-ab76a8d5b47c service nova] Acquiring lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:34:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-152962ec-c7f0-4b0b-9ab8-2114c8d8ecef req-131854eb-c08a-4aa3-ac5b-ab76a8d5b47c service nova] Acquired lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:34:37 user nova-compute[75102]: DEBUG nova.network.neutron [req-152962ec-c7f0-4b0b-9ab8-2114c8d8ecef req-131854eb-c08a-4aa3-ac5b-ab76a8d5b47c service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:34:37 user nova-compute[75102]: DEBUG nova.network.neutron [req-152962ec-c7f0-4b0b-9ab8-2114c8d8ecef req-131854eb-c08a-4aa3-ac5b-ab76a8d5b47c service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updated VIF entry in instance network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:34:37 user nova-compute[75102]: DEBUG nova.network.neutron [req-152962ec-c7f0-4b0b-9ab8-2114c8d8ecef req-131854eb-c08a-4aa3-ac5b-ab76a8d5b47c service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updating instance_info_cache with network_info: [{"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.187", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:34:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-152962ec-c7f0-4b0b-9ab8-2114c8d8ecef req-131854eb-c08a-4aa3-ac5b-ab76a8d5b47c service nova] Releasing lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:34:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-09d267bc-78b6-4388-b633-72d0de6d8aa5 req-f33bcc32-1bf3-4ea7-b63f-07b9bf60c288 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:34:38 user nova-compute[75102]: DEBUG nova.compute.manager [req-09d267bc-78b6-4388-b633-72d0de6d8aa5 req-f33bcc32-1bf3-4ea7-b63f-07b9bf60c288 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing instance network info cache due to event network-changed-c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:34:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-09d267bc-78b6-4388-b633-72d0de6d8aa5 req-f33bcc32-1bf3-4ea7-b63f-07b9bf60c288 service nova] Acquiring lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:34:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-09d267bc-78b6-4388-b633-72d0de6d8aa5 req-f33bcc32-1bf3-4ea7-b63f-07b9bf60c288 service nova] Acquired lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:34:38 user nova-compute[75102]: DEBUG nova.network.neutron [req-09d267bc-78b6-4388-b633-72d0de6d8aa5 req-f33bcc32-1bf3-4ea7-b63f-07b9bf60c288 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Refreshing network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:34:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:38 user nova-compute[75102]: INFO nova.compute.manager [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Detaching volume a441766b-2e55-40fa-be9e-5b7d5c6aa0b8
Nov 10 16:34:38 user nova-compute[75102]: INFO nova.virt.block_device [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Attempting to driver detach volume a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 from mountpoint /dev/vdb
Nov 10 16:34:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Attempting to detach device vdb from instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:34:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:34:38 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:34:38 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:34:38 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:34:38 user nova-compute[75102]:   <serial>a441766b-2e55-40fa-be9e-5b7d5c6aa0b8</serial>
Nov 10 16:34:38 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:34:38 user nova-compute[75102]: </disk>
Nov 10 16:34:38 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:34:39 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully detached device vdb from instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b from the persistent domain config.
Nov 10 16:34:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:34:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:34:39 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:34:39 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:34:39 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:34:39 user nova-compute[75102]:   <serial>a441766b-2e55-40fa-be9e-5b7d5c6aa0b8</serial>
Nov 10 16:34:39 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:34:39 user nova-compute[75102]: </disk>
Nov 10 16:34:39 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:34:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-09d267bc-78b6-4388-b633-72d0de6d8aa5 req-f33bcc32-1bf3-4ea7-b63f-07b9bf60c288 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updated VIF entry in instance network info cache for port c887ac21-4c60-4ba5-8c1b-1fcfae69e385. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:34:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-09d267bc-78b6-4388-b633-72d0de6d8aa5 req-f33bcc32-1bf3-4ea7-b63f-07b9bf60c288 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updating instance_info_cache with network_info: [{"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:34:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-09d267bc-78b6-4388-b633-72d0de6d8aa5 req-f33bcc32-1bf3-4ea7-b63f-07b9bf60c288 service nova] Releasing lock "refresh_cache-c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:34:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:34:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:42 user nova-compute[75102]: INFO nova.compute.manager [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Terminating instance
Nov 10 16:34:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:34:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-ff72c2d1-6886-4795-b8f5-99343a78e45f req-ad330e20-338d-408b-b5c3-362c8ad0728e service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-unplugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ff72c2d1-6886-4795-b8f5-99343a78e45f req-ad330e20-338d-408b-b5c3-362c8ad0728e service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ff72c2d1-6886-4795-b8f5-99343a78e45f req-ad330e20-338d-408b-b5c3-362c8ad0728e service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ff72c2d1-6886-4795-b8f5-99343a78e45f req-ad330e20-338d-408b-b5c3-362c8ad0728e service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-ff72c2d1-6886-4795-b8f5-99343a78e45f req-ad330e20-338d-408b-b5c3-362c8ad0728e service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-unplugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-ff72c2d1-6886-4795-b8f5-99343a78e45f req-ad330e20-338d-408b-b5c3-362c8ad0728e service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-unplugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:43 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Instance destroyed successfully.
Nov 10 16:34:43 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'resources' on Instance uuid 6c571e41-3f17-40f4-bcbc-4f3f86585d3f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:28:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-489219966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-489219966',id=27,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:31:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-8idszope',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:32:58Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=6c571e41-3f17-40f4-bcbc-4f3f86585d3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "address": "fa:16:3e:b1:9e:05", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap728d5a24-aa", "ovs_interfaceid": "728d5a24-aa97-4f3f-b8b0-3436cdb1d100", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:05,bridge_name='br-int',has_traffic_filtering=True,id=728d5a24-aa97-4f3f-b8b0-3436cdb1d100,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d5a24-aa') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_vif [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:05,bridge_name='br-int',has_traffic_filtering=True,id=728d5a24-aa97-4f3f-b8b0-3436cdb1d100,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d5a24-aa') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap728d5a24-aa, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1bc36e94-b268-447e-b6a9-decb5e256531) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:34:43 user nova-compute[75102]: INFO os_vif [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:9e:05,bridge_name='br-int',has_traffic_filtering=True,id=728d5a24-aa97-4f3f-b8b0-3436cdb1d100,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap728d5a24-aa')
Nov 10 16:34:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ZsxEXbNA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:34:43 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a8fe76-5ef7-45df-ba7e-7678192a5e76]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:34:43 user nova-compute[75102]: No targets found.
Nov 10 16:34:43 user nova-compute[75102]: iSNS:
Nov 10 16:34:43 user nova-compute[75102]: No targets found.
Nov 10 16:34:43 user nova-compute[75102]: STATIC:
Nov 10 16:34:43 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62
Nov 10 16:34:43 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:34:43 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:34:43 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:34:43 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:34:43 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:34:43 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8
Nov 10 16:34:43 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:34:43 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:34:43 user nova-compute[75102]: FIRMWARE:
Nov 10 16:34:43 user nova-compute[75102]: No targets found.
Nov 10 16:34:43 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:34:43 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:34:43 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6105c4d-5e2f-4dea-8aab-63f45baa1476]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ca793d-b468-4e00-b387-998b680b9784]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:34:43 user nova-compute[75102]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)
Nov 10 16:34:43 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:34:43 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 (non-flash)
Nov 10 16:34:43 user nova-compute[75102]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)
Nov 10 16:34:43 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:34:43 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74780550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62'): ({'sde'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Removing single pathed devices sde {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb3fde1-6675-4291-96cb-0c240392715c]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b171cd19-6b76-447a-af69-36de6fcdde8f]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flushing IO for device /dev/sde {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1244de8-58eb-4a57-9abf-cdbf0fd034b4]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[283d4a91-2a39-4c00-8d45-0a0c37b2d2c8]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c35eb4-db2d-4856-b642-a4b6eaa1bbe6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:34:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[56093496-f400-4709-9e59-0f7e0ec8d6b3]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62, portal: 172.16.0.220,3260]
Nov 10 16:34:44 user nova-compute[75102]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62, portal: 172.16.0.220,3260] successful.
Nov 10 16:34:44 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:daf0210e-15d3-4819-adb4-77d798e1bf62 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[51d3045a-8f19-4d0b-8734-a979035d3e4e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] <== disconnect_volume: return (353ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:34:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Deleting instance files /opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f_del
Nov 10 16:34:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Deletion of /opt/stack/data/nova/instances/6c571e41-3f17-40f4-bcbc-4f3f86585d3f_del complete
Nov 10 16:34:44 user nova-compute[75102]: INFO nova.compute.manager [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 10 16:34:44 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:34:44 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:34:44 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Took 0.83 seconds to deallocate network for instance.
Nov 10 16:34:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-5caa57ea-c470-4e0c-84de-0d1b2afec1c9 req-b14a439a-cea6-4a99-aabf-86949e4c07bd service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-deleted-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:34:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-caa85bca-a47e-4a61-894a-7ae359af563c req-1c3a7537-0336-483b-91a7-be769d1e3f7c service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:34:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-caa85bca-a47e-4a61-894a-7ae359af563c req-1c3a7537-0336-483b-91a7-be769d1e3f7c service nova] Acquiring lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-caa85bca-a47e-4a61-894a-7ae359af563c req-1c3a7537-0336-483b-91a7-be769d1e3f7c service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-caa85bca-a47e-4a61-894a-7ae359af563c req-1c3a7537-0336-483b-91a7-be769d1e3f7c service nova] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-caa85bca-a47e-4a61-894a-7ae359af563c req-1c3a7537-0336-483b-91a7-be769d1e3f7c service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] No waiting events found dispatching network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:34:45 user nova-compute[75102]: WARNING nova.compute.manager [req-caa85bca-a47e-4a61-894a-7ae359af563c req-1c3a7537-0336-483b-91a7-be769d1e3f7c service nova] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Received unexpected event network-vif-plugged-728d5a24-aa97-4f3f-b8b0-3436cdb1d100 for instance with vm_state active and task_state deleting.
Nov 10 16:34:46 user nova-compute[75102]: INFO nova.compute.manager [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 6c571e41-3f17-40f4-bcbc-4f3f86585d3f] Took 1.28 seconds to detach 1 volumes for instance.
Nov 10 16:34:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:34:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:34:46 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:34:46 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:34:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.377s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:46 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Deleted allocations for instance 6c571e41-3f17-40f4-bcbc-4f3f86585d3f
Nov 10 16:34:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f3983c95-64df-4d0d-9270-d7ac6553ca44 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "6c571e41-3f17-40f4-bcbc-4f3f86585d3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.922s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:34:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:58 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:34:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:34:59 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b is timed out.
Nov 10 16:34:59 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully detached device vdb from instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b from the live domain config.
Nov 10 16:34:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'JPLolEnj', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:34:59 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[854e3afc-de27-46ce-9479-3d405bf08fe6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:34:59 user nova-compute[75102]: No targets found.
Nov 10 16:34:59 user nova-compute[75102]: iSNS:
Nov 10 16:34:59 user nova-compute[75102]: No targets found.
Nov 10 16:34:59 user nova-compute[75102]: STATIC:
Nov 10 16:34:59 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:34:59 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:34:59 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:34:59 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8
Nov 10 16:34:59 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:34:59 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:34:59 user nova-compute[75102]: FIRMWARE:
Nov 10 16:34:59 user nova-compute[75102]: No targets found.
Nov 10 16:34:59 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:34:59 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:34:59 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[12dbef43-80df-411d-bace-9ef0d8cadb35]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[40a90d21-a3e3-4269-8765-ded6b6e51bec]: (4, ('tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)
Nov 10 16:34:59 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:34:59 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsi session list stdout=tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 (non-flash)
Nov 10 16:34:59 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:34:59 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74604f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f597306e-5d4b-4746-89ac-95afbb021a13]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c519fb7-5c29-4ac5-858f-ce957b75355a]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fd7038e-511b-44f1-96cb-13710ab7b561]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.045s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[251cee21-80a5-4b98-b779-4b7f8d2a6c6b]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1cacfe-b538-47b3-8b15-1f07bc2392df]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98c5d5f-629e-4cbc-b0bf-f448be79a76f]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8, portal: 172.16.0.220,3260]
Nov 10 16:34:59 user nova-compute[75102]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8, portal: 172.16.0.220,3260] successful.
Nov 10 16:34:59 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a441766b-2e55-40fa-be9e-5b7d5c6aa0b8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fab080f-65c3-4be9-8c0f-3cbdf9982f08]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] <== disconnect_volume: return (321ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:34:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:35:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "66e94840-e8e6-4345-9a7a-927c16a54cdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:35:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:00 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:35:00 user nova-compute[75102]: INFO nova.compute.claims [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Claim successful on node user
Nov 10 16:35:00 user nova-compute[75102]: DEBUG nova.objects.instance [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'flavor' on Instance uuid c34e2e7a-11a3-4718-9d67-f3eab7f21e4b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:35:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-548103a6-feb5-4a35-817d-3f1d35e06d13 tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.053s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:01 user nova-compute[75102]: INFO nova.compute.manager [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Terminating instance
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.613s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.network.neutron [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:35:01 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.policy [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a6ef288da57b4a26b32fd2d368fa85a6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '221beb548fbb455ca011f3a3fc7c4d34', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.compute.manager [req-4e4b8399-4fcb-40c1-b9b3-e09ac51e71c1 req-877932c0-838a-44f1-82af-9666e847b580 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-unplugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4e4b8399-4fcb-40c1-b9b3-e09ac51e71c1 req-877932c0-838a-44f1-82af-9666e847b580 service nova] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4e4b8399-4fcb-40c1-b9b3-e09ac51e71c1 req-877932c0-838a-44f1-82af-9666e847b580 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4e4b8399-4fcb-40c1-b9b3-e09ac51e71c1 req-877932c0-838a-44f1-82af-9666e847b580 service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.compute.manager [req-4e4b8399-4fcb-40c1-b9b3-e09ac51e71c1 req-877932c0-838a-44f1-82af-9666e847b580 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] No waiting events found dispatching network-vif-unplugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.compute.manager [req-4e4b8399-4fcb-40c1-b9b3-e09ac51e71c1 req-877932c0-838a-44f1-82af-9666e847b580 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-unplugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:35:01 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Creating image(s)
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "/opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "/opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "/opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Instance destroyed successfully.
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'resources' on Instance uuid 22865b86-3ce3-4ec7-89c4-fc08684a0a60 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:28:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-1369602086',display_name='tempest-ServerActionsTestOtherA-server-572106926',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-1369602086',id=28,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCS9aEsC9DkyiXkRLS5dGIYoAHUIm63zekg0VMpktGwjiXXfqBh0WaQ64TY7S97+mYuRLBNgDzeBuXpCBuN7hevXuih4l498smbzR6XPH3ZHHk/XQcFpZYMuQ6Hr0yiLvg==',key_name='tempest-keypair-439595601',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:31:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-y3on4ld3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:31:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=22865b86-3ce3-4ec7-89c4-fc08684a0a60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "address": "fa:16:3e:d0:a8:da", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.104", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap463f7077-f0", "ovs_interfaceid": "463f7077-f0c7-4f09-b53b-6d374ec16fa2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG os_vif [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap463f7077-f0, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4758b9e9-7d0e-4c24-905a-363b72e5d67d) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:02 user nova-compute[75102]: INFO os_vif [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d0:a8:da,bridge_name='br-int',has_traffic_filtering=True,id=463f7077-f0c7-4f09-b53b-6d374ec16fa2,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap463f7077-f0')
Nov 10 16:35:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Deleting instance files /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60_del
Nov 10 16:35:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Deletion of /opt/stack/data/nova/instances/22865b86-3ce3-4ec7-89c4-fc08684a0a60_del complete
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:02 user nova-compute[75102]: INFO nova.compute.manager [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk 1073741824" returned: 0 in 0.061s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.255s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Checking if we can resize image /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Successfully created port: f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Cannot resize image /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Ensure instance console log exists: /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-493012ae-eb39-4d34-8699-505aadacbfa2 req-00436505-3d1a-46a4-b00b-694d834afca9 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-deleted-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:03 user nova-compute[75102]: INFO nova.compute.manager [req-493012ae-eb39-4d34-8699-505aadacbfa2 req-00436505-3d1a-46a4-b00b-694d834afca9 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Neutron deleted interface 463f7077-f0c7-4f09-b53b-6d374ec16fa2; detaching it from the instance and deleting it from the info cache
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.network.neutron [req-493012ae-eb39-4d34-8699-505aadacbfa2 req-00436505-3d1a-46a4-b00b-694d834afca9 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:03 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Took 0.83 seconds to deallocate network for instance.
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-493012ae-eb39-4d34-8699-505aadacbfa2 req-00436505-3d1a-46a4-b00b-694d834afca9 service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Detach interface failed, port_id=463f7077-f0c7-4f09-b53b-6d374ec16fa2, reason: Instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Successfully updated port: f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "refresh_cache-66e94840-e8e6-4345-9a7a-927c16a54cdb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquired lock "refresh_cache-66e94840-e8e6-4345-9a7a-927c16a54cdb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.107s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:35:03 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Deleted allocations for instance 22865b86-3ce3-4ec7-89c4-fc08684a0a60
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7576e81b-bb19-476c-a4e8-0564077cb457 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.443s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] Acquiring lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] Lock "22865b86-3ce3-4ec7-89c4-fc08684a0a60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] No waiting events found dispatching network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:03 user nova-compute[75102]: WARNING nova.compute.manager [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] [instance: 22865b86-3ce3-4ec7-89c4-fc08684a0a60] Received unexpected event network-vif-plugged-463f7077-f0c7-4f09-b53b-6d374ec16fa2 for instance with vm_state deleted and task_state None.
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received event network-changed-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Refreshing instance network info cache due to event network-changed-f46df2df-479f-417e-a1df-120eb9c9fe33. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] Acquiring lock "refresh_cache-66e94840-e8e6-4345-9a7a-927c16a54cdb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.network.neutron [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Updating instance_info_cache with network_info: [{"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Releasing lock "refresh_cache-66e94840-e8e6-4345-9a7a-927c16a54cdb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Instance network_info: |[{"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] Acquired lock "refresh_cache-66e94840-e8e6-4345-9a7a-927c16a54cdb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Refreshing network info cache for port f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Start _get_guest_xml network_info=[{"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:35:04 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:35:04 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:35:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2044120310',display_name='tempest-ServersNegativeTestJSON-server-2044120310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2044120310',id=34,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='221beb548fbb455ca011f3a3fc7c4d34',ramdisk_id='',reservation_id='r-bfyrt4ga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1842056783',owner_user_name='tempest-ServersNegativeTestJSON-1842056783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:35:02Z,user_data=None,user_id='a6ef288da57b4a26b32fd2d368fa85a6',uuid=66e94840-e8e6-4345-9a7a-927c16a54cdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converting VIF {"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:53:35,bridge_name='br-int',has_traffic_filtering=True,id=f46df2df-479f-417e-a1df-120eb9c9fe33,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46df2df-47') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.objects.instance [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lazy-loading 'pci_devices' on Instance uuid 66e94840-e8e6-4345-9a7a-927c16a54cdb {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:35:04 user nova-compute[75102]:   <uuid>66e94840-e8e6-4345-9a7a-927c16a54cdb</uuid>
Nov 10 16:35:04 user nova-compute[75102]:   <name>instance-00000022</name>
Nov 10 16:35:04 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:35:04 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:35:04 user nova-compute[75102]:   <metadata>
Nov 10 16:35:04 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:35:04 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:35:04 user nova-compute[75102]:       <nova:name>tempest-ServersNegativeTestJSON-server-2044120310</nova:name>
Nov 10 16:35:04 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:35:04</nova:creationTime>
Nov 10 16:35:04 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:35:04 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:35:04 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:35:04 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:35:04 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:35:04 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:35:04 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:35:04 user nova-compute[75102]:       <nova:owner>
Nov 10 16:35:04 user nova-compute[75102]:         <nova:user uuid="a6ef288da57b4a26b32fd2d368fa85a6">tempest-ServersNegativeTestJSON-1842056783-project-member</nova:user>
Nov 10 16:35:04 user nova-compute[75102]:         <nova:project uuid="221beb548fbb455ca011f3a3fc7c4d34">tempest-ServersNegativeTestJSON-1842056783</nova:project>
Nov 10 16:35:04 user nova-compute[75102]:       </nova:owner>
Nov 10 16:35:04 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:35:04 user nova-compute[75102]:       <nova:ports>
Nov 10 16:35:04 user nova-compute[75102]:         <nova:port uuid="f46df2df-479f-417e-a1df-120eb9c9fe33">
Nov 10 16:35:04 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 16:35:04 user nova-compute[75102]:         </nova:port>
Nov 10 16:35:04 user nova-compute[75102]:       </nova:ports>
Nov 10 16:35:04 user nova-compute[75102]:     </nova:instance>
Nov 10 16:35:04 user nova-compute[75102]:   </metadata>
Nov 10 16:35:04 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:35:04 user nova-compute[75102]:     <system>
Nov 10 16:35:04 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:35:04 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:35:04 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:35:04 user nova-compute[75102]:       <entry name="serial">66e94840-e8e6-4345-9a7a-927c16a54cdb</entry>
Nov 10 16:35:04 user nova-compute[75102]:       <entry name="uuid">66e94840-e8e6-4345-9a7a-927c16a54cdb</entry>
Nov 10 16:35:04 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:35:04 user nova-compute[75102]:     </system>
Nov 10 16:35:04 user nova-compute[75102]:   </sysinfo>
Nov 10 16:35:04 user nova-compute[75102]:   <os>
Nov 10 16:35:04 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:35:04 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:35:04 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:35:04 user nova-compute[75102]:   </os>
Nov 10 16:35:04 user nova-compute[75102]:   <features>
Nov 10 16:35:04 user nova-compute[75102]:     <acpi/>
Nov 10 16:35:04 user nova-compute[75102]:     <apic/>
Nov 10 16:35:04 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:35:04 user nova-compute[75102]:   </features>
Nov 10 16:35:04 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:35:04 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:35:04 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:35:04 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:35:04 user nova-compute[75102]:   </clock>
Nov 10 16:35:04 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:35:04 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:35:04 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:35:04 user nova-compute[75102]:   </cpu>
Nov 10 16:35:04 user nova-compute[75102]:   <devices>
Nov 10 16:35:04 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:35:04 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:35:04 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk"/>
Nov 10 16:35:04 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:35:04 user nova-compute[75102]:     </disk>
Nov 10 16:35:04 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:35:04 user nova-compute[75102]:       <mac address="fa:16:3e:a8:53:35"/>
Nov 10 16:35:04 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:35:04 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:35:04 user nova-compute[75102]:       <target dev="tapf46df2df-47"/>
Nov 10 16:35:04 user nova-compute[75102]:     </interface>
Nov 10 16:35:04 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:35:04 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/console.log" append="off"/>
Nov 10 16:35:04 user nova-compute[75102]:     </serial>
Nov 10 16:35:04 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:35:04 user nova-compute[75102]:     <video>
Nov 10 16:35:04 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:35:04 user nova-compute[75102]:     </video>
Nov 10 16:35:04 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:35:04 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:35:04 user nova-compute[75102]:     </rng>
Nov 10 16:35:04 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:35:04 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:35:04 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:35:04 user nova-compute[75102]:     </memballoon>
Nov 10 16:35:04 user nova-compute[75102]:   </devices>
Nov 10 16:35:04 user nova-compute[75102]: </domain>
Nov 10 16:35:04 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:35:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2044120310',display_name='tempest-ServersNegativeTestJSON-server-2044120310',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2044120310',id=34,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='221beb548fbb455ca011f3a3fc7c4d34',ramdisk_id='',reservation_id='r-bfyrt4ga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1842056783',owner_user_name='tempest-ServersNegativeTestJSON-1842056783-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:35:02Z,user_data=None,user_id='a6ef288da57b4a26b32fd2d368fa85a6',uuid=66e94840-e8e6-4345-9a7a-927c16a54cdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converting VIF {"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:53:35,bridge_name='br-int',has_traffic_filtering=True,id=f46df2df-479f-417e-a1df-120eb9c9fe33,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46df2df-47') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG os_vif [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:53:35,bridge_name='br-int',has_traffic_filtering=True,id=f46df2df-479f-417e-a1df-120eb9c9fe33,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46df2df-47') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3dbfdf30-8752-52a5-bc45-87563a121ecb', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf46df2df-47, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf46df2df-47, col_values=(('qos', UUID('a0823bd0-c59f-4f1d-b274-5e2c80fd805f')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf46df2df-47, col_values=(('external_ids', {'iface-id': 'f46df2df-479f-417e-a1df-120eb9c9fe33', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:53:35', 'vm-uuid': '66e94840-e8e6-4345-9a7a-927c16a54cdb'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:04 user nova-compute[75102]: INFO os_vif [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:53:35,bridge_name='br-int',has_traffic_filtering=True,id=f46df2df-479f-417e-a1df-120eb9c9fe33,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46df2df-47')
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] No VIF found with MAC fa:16:3e:a8:53:35, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Updated VIF entry in instance network info cache for port f46df2df-479f-417e-a1df-120eb9c9fe33. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.network.neutron [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Updating instance_info_cache with network_info: [{"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-88fdb80a-e7e1-4fe0-a7e1-2d957f859915 req-4420e6a6-62c6-4f53-8369-4fed1a13fdca service nova] Releasing lock "refresh_cache-66e94840-e8e6-4345-9a7a-927c16a54cdb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc/disk --force-share --output=json" returned: 0 in 0.250s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b/disk --force-share --output=json" returned: 0 in 0.226s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.237s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-b919821e-a78f-4f59-a943-a7d57c39e03f req-c0928037-3238-46dc-b03b-77c0db56db83 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received event network-vif-plugged-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b919821e-a78f-4f59-a943-a7d57c39e03f req-c0928037-3238-46dc-b03b-77c0db56db83 service nova] Acquiring lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b919821e-a78f-4f59-a943-a7d57c39e03f req-c0928037-3238-46dc-b03b-77c0db56db83 service nova] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b919821e-a78f-4f59-a943-a7d57c39e03f req-c0928037-3238-46dc-b03b-77c0db56db83 service nova] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-b919821e-a78f-4f59-a943-a7d57c39e03f req-c0928037-3238-46dc-b03b-77c0db56db83 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] No waiting events found dispatching network-vif-plugged-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:06 user nova-compute[75102]: WARNING nova.compute.manager [req-b919821e-a78f-4f59-a943-a7d57c39e03f req-c0928037-3238-46dc-b03b-77c0db56db83 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received unexpected event network-vif-plugged-f46df2df-479f-417e-a1df-120eb9c9fe33 for instance with vm_state building and task_state spawning.
Nov 10 16:35:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-bb4b92d8-abe8-4380-aede-67e62d4c7b4a req-1cf2fbbe-17d1-477e-9dc9-f546302e2baa service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received event network-vif-plugged-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bb4b92d8-abe8-4380-aede-67e62d4c7b4a req-1cf2fbbe-17d1-477e-9dc9-f546302e2baa service nova] Acquiring lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bb4b92d8-abe8-4380-aede-67e62d4c7b4a req-1cf2fbbe-17d1-477e-9dc9-f546302e2baa service nova] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bb4b92d8-abe8-4380-aede-67e62d4c7b4a req-1cf2fbbe-17d1-477e-9dc9-f546302e2baa service nova] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-bb4b92d8-abe8-4380-aede-67e62d4c7b4a req-1cf2fbbe-17d1-477e-9dc9-f546302e2baa service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] No waiting events found dispatching network-vif-plugged-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:08 user nova-compute[75102]: WARNING nova.compute.manager [req-bb4b92d8-abe8-4380-aede-67e62d4c7b4a req-1cf2fbbe-17d1-477e-9dc9-f546302e2baa service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received unexpected event network-vif-plugged-f46df2df-479f-417e-a1df-120eb9c9fe33 for instance with vm_state building and task_state spawning.
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:35:08 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:35:08 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7814MB free_disk=24.927722930908203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:08 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Instance spawned successfully.
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:35:08 user nova-compute[75102]: INFO nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Took 6.86 seconds to spawn the instance on the hypervisor.
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:35:08 user nova-compute[75102]: INFO nova.compute.manager [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Took 7.96 seconds to build instance.
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 68e8fc6f-6d54-4804-b45c-4096f68a3894 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 66e94840-e8e6-4345-9a7a-927c16a54cdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:35:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-673a3b0f-87a9-43fc-8ce3-a4dfad121813 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.091s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:09 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:35:09 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:35:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:35:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updating instance_info_cache with network_info: [{"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:35:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:35:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:33 user nova-compute[75102]: INFO nova.compute.manager [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Terminating instance
Nov 10 16:35:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:35:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-153cebe3-038b-4b67-8c05-cdd562315b0e req-4c0007b1-cbc7-4098-a945-dba21136e97f service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-unplugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-153cebe3-038b-4b67-8c05-cdd562315b0e req-4c0007b1-cbc7-4098-a945-dba21136e97f service nova] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-153cebe3-038b-4b67-8c05-cdd562315b0e req-4c0007b1-cbc7-4098-a945-dba21136e97f service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-153cebe3-038b-4b67-8c05-cdd562315b0e req-4c0007b1-cbc7-4098-a945-dba21136e97f service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-153cebe3-038b-4b67-8c05-cdd562315b0e req-4c0007b1-cbc7-4098-a945-dba21136e97f service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] No waiting events found dispatching network-vif-unplugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-153cebe3-038b-4b67-8c05-cdd562315b0e req-4c0007b1-cbc7-4098-a945-dba21136e97f service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-unplugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Instance destroyed successfully.
Nov 10 16:35:34 user nova-compute[75102]: DEBUG nova.objects.instance [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'resources' on Instance uuid b0b033f4-4325-4d53-bd0d-1c90bbfa54cc {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-110130726',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-110130726',id=20,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:25:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-rxk0c7zp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:27:16Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=b0b033f4-4325-4d53-bd0d-1c90bbfa54cc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "address": "fa:16:3e:ba:32:e8", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaa348bf6-ca", "ovs_interfaceid": "aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ba:32:e8,bridge_name='br-int',has_traffic_filtering=True,id=aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa348bf6-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG os_vif [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:32:e8,bridge_name='br-int',has_traffic_filtering=True,id=aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa348bf6-ca') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaa348bf6-ca, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3efd8c56-0db5-4d8b-9eac-1a3d0e9ef2e0) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:35:34 user nova-compute[75102]: INFO os_vif [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ba:32:e8,bridge_name='br-int',has_traffic_filtering=True,id=aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaa348bf6-ca')
Nov 10 16:35:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Deleting instance files /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc_del
Nov 10 16:35:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Deletion of /opt/stack/data/nova/instances/b0b033f4-4325-4d53-bd0d-1c90bbfa54cc_del complete
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:34 user nova-compute[75102]: INFO nova.compute.manager [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 16:35:34 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:35:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:35 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Took 0.89 seconds to deallocate network for instance.
Nov 10 16:35:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-9c616163-fe2d-46a1-b3d8-2f8e4ff73e55 req-2145f226-8885-4a1d-b592-745ee040dd55 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-deleted-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lazy-loading 'flavor' on Instance uuid c9348a9d-5891-40f6-96c7-e8c7179cf315 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:35 user nova-compute[75102]: INFO nova.compute.manager [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Attaching volume 52df5f14-c03c-4bb4-a7a7-1311236efcef to /dev/vdb
Nov 10 16:35:35 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG os_brick.utils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.358s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8caf477b-43ab-4523-96ba-045c2a5c9a7a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fce4df7e-9907-4d28-bc67-1dd55f2cf57a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:35 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Deleted allocations for instance b0b033f4-4325-4d53-bd0d-1c90bbfa54cc
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20207de3-94e2-43f8-92b7-fbbcf41e6536]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2befea08-f902-4c09-9038-854f837156b6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:35:35 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:35:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb27353-f313-4e65-977a-178fad350f65]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG os_brick.utils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:35:35 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updating existing volume attachment record: 6d49ae59-7b93-40e5-934f-db1bd094500b {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1a0570b2-27c2-4fb4-b6f2-e6d076c7ecad tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.360s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] No waiting events found dispatching network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:36 user nova-compute[75102]: WARNING nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received unexpected event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b for instance with vm_state deleted and task_state None.
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] No waiting events found dispatching network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:36 user nova-compute[75102]: WARNING nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received unexpected event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b for instance with vm_state deleted and task_state None.
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received event network-changed-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Refreshing instance network info cache due to event network-changed-85633d7f-63c9-46e3-aedf-1d5252041c10. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Acquiring lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Acquired lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.network.neutron [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Refreshing network info cache for port 85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.network.neutron [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updated VIF entry in instance network info cache for port 85633d7f-63c9-46e3-aedf-1d5252041c10. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.network.neutron [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updating instance_info_cache with network_info: [{"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Releasing lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] No waiting events found dispatching network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:36 user nova-compute[75102]: WARNING nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received unexpected event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b for instance with vm_state deleted and task_state None.
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-unplugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] No waiting events found dispatching network-vif-unplugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:36 user nova-compute[75102]: WARNING nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received unexpected event network-vif-unplugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b for instance with vm_state deleted and task_state None.
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Acquiring lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] Lock "b0b033f4-4325-4d53-bd0d-1c90bbfa54cc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] No waiting events found dispatching network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:36 user nova-compute[75102]: WARNING nova.compute.manager [req-1e52d58d-e4b3-463b-832c-7fb2b8705701 req-4aa1b613-2047-42c8-b0de-91473fc16d39 service nova] [instance: b0b033f4-4325-4d53-bd0d-1c90bbfa54cc] Received unexpected event network-vif-plugged-aa348bf6-ca72-4cfa-9a53-bc841d1b3c6b for instance with vm_state deleted and task_state None.
Nov 10 16:35:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:42 user nova-compute[75102]: INFO nova.compute.manager [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Terminating instance
Nov 10 16:35:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG nova.compute.manager [req-ba8874c8-9200-4b4d-aa0e-5ce4c1272b5c req-b45c8ae3-3618-4e9c-957e-6777ae780142 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-unplugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ba8874c8-9200-4b4d-aa0e-5ce4c1272b5c req-b45c8ae3-3618-4e9c-957e-6777ae780142 service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ba8874c8-9200-4b4d-aa0e-5ce4c1272b5c req-b45c8ae3-3618-4e9c-957e-6777ae780142 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ba8874c8-9200-4b4d-aa0e-5ce4c1272b5c req-b45c8ae3-3618-4e9c-957e-6777ae780142 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG nova.compute.manager [req-ba8874c8-9200-4b4d-aa0e-5ce4c1272b5c req-b45c8ae3-3618-4e9c-957e-6777ae780142 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-unplugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG nova.compute.manager [req-ba8874c8-9200-4b4d-aa0e-5ce4c1272b5c req-b45c8ae3-3618-4e9c-957e-6777ae780142 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-unplugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Instance destroyed successfully.
Nov 10 16:35:43 user nova-compute[75102]: DEBUG nova.objects.instance [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lazy-loading 'resources' on Instance uuid c34e2e7a-11a3-4718-9d67-f3eab7f21e4b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:29:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-2117035397',display_name='tempest-TestMinimumBasicScenario-server-2117035397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-2117035397',id=29,image_ref='9c0f285c-c603-4b57-b5a5-81646ab4f6f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLZ2C6VI0o+n/Ec/80gaXDO47lApEJiNU8WtQ8RoqCNzDoTFAVxHoZNY1N5UkWmNf1QXwDEXdk8QWQrrDg/Gu8ulW6Trg6rtM3/srDEnYqeMbpHbRa8/op6g/YM9aXJi5g==',key_name='tempest-TestMinimumBasicScenario-397374048',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:30:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3975de59dc974b5299a9765364645f24',ramdisk_id='',reservation_id='r-gkgs93oo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='9c0f285c-c603-4b57-b5a5-81646ab4f6f6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-86254494',owner_user_name='tempest-TestMinimumBasicScenario-86254494-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:32:52Z,user_data=None,user_id='3a487c00935d4baa981cc8a1567af2a8',uuid=c34e2e7a-11a3-4718-9d67-f3eab7f21e4b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converting VIF {"id": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "address": "fa:16:3e:b9:84:3c", "network": {"id": "e01537f2-f881-4d36-98e6-3c8e1207f34f", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-318128391-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3975de59dc974b5299a9765364645f24", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc887ac21-4c", "ovs_interfaceid": "c887ac21-4c60-4ba5-8c1b-1fcfae69e385", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b9:84:3c,bridge_name='br-int',has_traffic_filtering=True,id=c887ac21-4c60-4ba5-8c1b-1fcfae69e385,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc887ac21-4c') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG os_vif [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:84:3c,bridge_name='br-int',has_traffic_filtering=True,id=c887ac21-4c60-4ba5-8c1b-1fcfae69e385,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc887ac21-4c') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc887ac21-4c, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e95e8604-9ced-4dfc-ae41-c62fda11554f) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:35:43 user nova-compute[75102]: INFO os_vif [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b9:84:3c,bridge_name='br-int',has_traffic_filtering=True,id=c887ac21-4c60-4ba5-8c1b-1fcfae69e385,network=Network(e01537f2-f881-4d36-98e6-3c8e1207f34f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc887ac21-4c')
Nov 10 16:35:43 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Deleting instance files /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b_del
Nov 10 16:35:43 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Deletion of /opt/stack/data/nova/instances/c34e2e7a-11a3-4718-9d67-f3eab7f21e4b_del complete
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: INFO nova.compute.manager [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 10 16:35:43 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:43 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:43 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Took 0.67 seconds to deallocate network for instance.
Nov 10 16:35:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-fdfc4043-5614-4565-bd46-7d76dbcab435 req-6b85ffe0-0ed5-4c3d-b9db-97672dabf457 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-deleted-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.470s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:44 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Deleted allocations for instance c34e2e7a-11a3-4718-9d67-f3eab7f21e4b
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:44 user nova-compute[75102]: WARNING nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state deleted and task_state None.
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:44 user nova-compute[75102]: WARNING nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state deleted and task_state None.
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:44 user nova-compute[75102]: WARNING nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state deleted and task_state None.
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-unplugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-unplugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:44 user nova-compute[75102]: WARNING nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-unplugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state deleted and task_state None.
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Acquiring lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] No waiting events found dispatching network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:35:44 user nova-compute[75102]: WARNING nova.compute.manager [req-59cec87f-13b3-4897-b0ee-78fd7c0dbb38 req-3092fedf-33cc-4b6a-aa57-4ce36870c829 service nova] [instance: c34e2e7a-11a3-4718-9d67-f3eab7f21e4b] Received unexpected event network-vif-plugged-c887ac21-4c60-4ba5-8c1b-1fcfae69e385 for instance with vm_state deleted and task_state None.
Nov 10 16:35:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-db1fc27c-6b41-4e6f-9ec8-615bce4bba0c tempest-TestMinimumBasicScenario-86254494 tempest-TestMinimumBasicScenario-86254494-project-member] Lock "c34e2e7a-11a3-4718-9d67-f3eab7f21e4b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.396s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:35:55 user nova-compute[75102]: INFO nova.compute.claims [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Claim successful on node user
Nov 10 16:35:55 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.405s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:35:55 user nova-compute[75102]: DEBUG nova.network.neutron [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:35:55 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:35:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG nova.policy [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f78829a85087437da8edf53a02ae7358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b9ad4975bb43fdbb94dd2742b3d590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:35:56 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Creating image(s)
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "/opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "/opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "/opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.191s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk 1073741824" returned: 0 in 0.052s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:35:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Successfully created port: b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Cannot resize image /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Ensure instance console log exists: /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.network.neutron [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Successfully updated port: b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-52742131-0fed-49d4-9bef-c35c1e5ad636 req-5118c0bd-1118-48a9-9244-6a0bdb850ffd service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received event network-changed-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-52742131-0fed-49d4-9bef-c35c1e5ad636 req-5118c0bd-1118-48a9-9244-6a0bdb850ffd service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Refreshing instance network info cache due to event network-changed-b467529d-8282-454a-bfe1-c9d6e4f9780a. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-52742131-0fed-49d4-9bef-c35c1e5ad636 req-5118c0bd-1118-48a9-9244-6a0bdb850ffd service nova] Acquiring lock "refresh_cache-4011f0df-65d5-43a9-bc81-876e451a9095" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-52742131-0fed-49d4-9bef-c35c1e5ad636 req-5118c0bd-1118-48a9-9244-6a0bdb850ffd service nova] Acquired lock "refresh_cache-4011f0df-65d5-43a9-bc81-876e451a9095" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.network.neutron [req-52742131-0fed-49d4-9bef-c35c1e5ad636 req-5118c0bd-1118-48a9-9244-6a0bdb850ffd service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Refreshing network info cache for port b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "refresh_cache-4011f0df-65d5-43a9-bc81-876e451a9095" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.network.neutron [req-52742131-0fed-49d4-9bef-c35c1e5ad636 req-5118c0bd-1118-48a9-9244-6a0bdb850ffd service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.network.neutron [req-52742131-0fed-49d4-9bef-c35c1e5ad636 req-5118c0bd-1118-48a9-9244-6a0bdb850ffd service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-52742131-0fed-49d4-9bef-c35c1e5ad636 req-5118c0bd-1118-48a9-9244-6a0bdb850ffd service nova] Releasing lock "refresh_cache-4011f0df-65d5-43a9-bc81-876e451a9095" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquired lock "refresh_cache-4011f0df-65d5-43a9-bc81-876e451a9095" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:35:57 user nova-compute[75102]: DEBUG nova.network.neutron [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Updating instance_info_cache with network_info: [{"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Releasing lock "refresh_cache-4011f0df-65d5-43a9-bc81-876e451a9095" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Instance network_info: |[{"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Start _get_guest_xml network_info=[{"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:35:58 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:35:58 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-679472681',display_name='tempest-VolumesSnapshotTestJSON-instance-679472681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-679472681',id=35,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYhAhKgSUV5NfoOw/dNsWeWgys7bRTKP2syQtAVu185olwJ9OHiIljveAa9UtDk6kybwjQL52KcnpZA/dBTzznnuSG8Gu0Fzwmu+UGpnI+y/Nh2popsgRiwMNrkct5UBA==',key_name='tempest-keypair-1349778118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b9ad4975bb43fdbb94dd2742b3d590',ramdisk_id='',reservation_id='r-77btjyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-803710656',owner_user_name='tempest-VolumesSnapshotTestJSON-803710656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78829a85087437da8edf53a02ae7358',uuid=4011f0df-65d5-43a9-bc81-876e451a9095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converting VIF {"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=b467529d-8282-454a-bfe1-c9d6e4f9780a,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb467529d-82') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.objects.instance [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'pci_devices' on Instance uuid 4011f0df-65d5-43a9-bc81-876e451a9095 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:35:58 user nova-compute[75102]:   <uuid>4011f0df-65d5-43a9-bc81-876e451a9095</uuid>
Nov 10 16:35:58 user nova-compute[75102]:   <name>instance-00000023</name>
Nov 10 16:35:58 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:35:58 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:35:58 user nova-compute[75102]:   <metadata>
Nov 10 16:35:58 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:35:58 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:35:58 user nova-compute[75102]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-679472681</nova:name>
Nov 10 16:35:58 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:35:58</nova:creationTime>
Nov 10 16:35:58 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:35:58 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:35:58 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:35:58 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:35:58 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:35:58 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:35:58 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:35:58 user nova-compute[75102]:       <nova:owner>
Nov 10 16:35:58 user nova-compute[75102]:         <nova:user uuid="f78829a85087437da8edf53a02ae7358">tempest-VolumesSnapshotTestJSON-803710656-project-member</nova:user>
Nov 10 16:35:58 user nova-compute[75102]:         <nova:project uuid="09b9ad4975bb43fdbb94dd2742b3d590">tempest-VolumesSnapshotTestJSON-803710656</nova:project>
Nov 10 16:35:58 user nova-compute[75102]:       </nova:owner>
Nov 10 16:35:58 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:35:58 user nova-compute[75102]:       <nova:ports>
Nov 10 16:35:58 user nova-compute[75102]:         <nova:port uuid="b467529d-8282-454a-bfe1-c9d6e4f9780a">
Nov 10 16:35:58 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 16:35:58 user nova-compute[75102]:         </nova:port>
Nov 10 16:35:58 user nova-compute[75102]:       </nova:ports>
Nov 10 16:35:58 user nova-compute[75102]:     </nova:instance>
Nov 10 16:35:58 user nova-compute[75102]:   </metadata>
Nov 10 16:35:58 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:35:58 user nova-compute[75102]:     <system>
Nov 10 16:35:58 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:35:58 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:35:58 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:35:58 user nova-compute[75102]:       <entry name="serial">4011f0df-65d5-43a9-bc81-876e451a9095</entry>
Nov 10 16:35:58 user nova-compute[75102]:       <entry name="uuid">4011f0df-65d5-43a9-bc81-876e451a9095</entry>
Nov 10 16:35:58 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:35:58 user nova-compute[75102]:     </system>
Nov 10 16:35:58 user nova-compute[75102]:   </sysinfo>
Nov 10 16:35:58 user nova-compute[75102]:   <os>
Nov 10 16:35:58 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:35:58 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:35:58 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:35:58 user nova-compute[75102]:   </os>
Nov 10 16:35:58 user nova-compute[75102]:   <features>
Nov 10 16:35:58 user nova-compute[75102]:     <acpi/>
Nov 10 16:35:58 user nova-compute[75102]:     <apic/>
Nov 10 16:35:58 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:35:58 user nova-compute[75102]:   </features>
Nov 10 16:35:58 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:35:58 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:35:58 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:35:58 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:35:58 user nova-compute[75102]:   </clock>
Nov 10 16:35:58 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:35:58 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:35:58 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:35:58 user nova-compute[75102]:   </cpu>
Nov 10 16:35:58 user nova-compute[75102]:   <devices>
Nov 10 16:35:58 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:35:58 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:35:58 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk"/>
Nov 10 16:35:58 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:35:58 user nova-compute[75102]:     </disk>
Nov 10 16:35:58 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:35:58 user nova-compute[75102]:       <mac address="fa:16:3e:08:4b:7d"/>
Nov 10 16:35:58 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:35:58 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:35:58 user nova-compute[75102]:       <target dev="tapb467529d-82"/>
Nov 10 16:35:58 user nova-compute[75102]:     </interface>
Nov 10 16:35:58 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:35:58 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/console.log" append="off"/>
Nov 10 16:35:58 user nova-compute[75102]:     </serial>
Nov 10 16:35:58 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:35:58 user nova-compute[75102]:     <video>
Nov 10 16:35:58 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:35:58 user nova-compute[75102]:     </video>
Nov 10 16:35:58 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:35:58 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:35:58 user nova-compute[75102]:     </rng>
Nov 10 16:35:58 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:35:58 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:35:58 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:35:58 user nova-compute[75102]:     </memballoon>
Nov 10 16:35:58 user nova-compute[75102]:   </devices>
Nov 10 16:35:58 user nova-compute[75102]: </domain>
Nov 10 16:35:58 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-679472681',display_name='tempest-VolumesSnapshotTestJSON-instance-679472681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-679472681',id=35,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYhAhKgSUV5NfoOw/dNsWeWgys7bRTKP2syQtAVu185olwJ9OHiIljveAa9UtDk6kybwjQL52KcnpZA/dBTzznnuSG8Gu0Fzwmu+UGpnI+y/Nh2popsgRiwMNrkct5UBA==',key_name='tempest-keypair-1349778118',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b9ad4975bb43fdbb94dd2742b3d590',ramdisk_id='',reservation_id='r-77btjyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-803710656',owner_user_name='tempest-VolumesSnapshotTestJSON-803710656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:35:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78829a85087437da8edf53a02ae7358',uuid=4011f0df-65d5-43a9-bc81-876e451a9095,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converting VIF {"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=b467529d-8282-454a-bfe1-c9d6e4f9780a,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb467529d-82') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG os_vif [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=b467529d-8282-454a-bfe1-c9d6e4f9780a,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb467529d-82') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d53ebed-9a48-5fc2-aa88-094d4648b728', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb467529d-82, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb467529d-82, col_values=(('qos', UUID('db755c9b-f28a-4308-b799-b36a6f360134')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb467529d-82, col_values=(('external_ids', {'iface-id': 'b467529d-8282-454a-bfe1-c9d6e4f9780a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:4b:7d', 'vm-uuid': '4011f0df-65d5-43a9-bc81-876e451a9095'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:35:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:35:58 user nova-compute[75102]: INFO os_vif [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=b467529d-8282-454a-bfe1-c9d6e4f9780a,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb467529d-82')
Nov 10 16:35:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:35:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No VIF found with MAC fa:16:3e:08:4b:7d, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:35:59 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:00 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-4d32c515-4c00-4924-9a6e-a2b3f960b370 req-5ddd0d89-e52d-4e2e-89e3-cd5e367c5ba2 service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received event network-vif-plugged-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:36:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4d32c515-4c00-4924-9a6e-a2b3f960b370 req-5ddd0d89-e52d-4e2e-89e3-cd5e367c5ba2 service nova] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4d32c515-4c00-4924-9a6e-a2b3f960b370 req-5ddd0d89-e52d-4e2e-89e3-cd5e367c5ba2 service nova] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4d32c515-4c00-4924-9a6e-a2b3f960b370 req-5ddd0d89-e52d-4e2e-89e3-cd5e367c5ba2 service nova] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-4d32c515-4c00-4924-9a6e-a2b3f960b370 req-5ddd0d89-e52d-4e2e-89e3-cd5e367c5ba2 service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] No waiting events found dispatching network-vif-plugged-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:36:00 user nova-compute[75102]: WARNING nova.compute.manager [req-4d32c515-4c00-4924-9a6e-a2b3f960b370 req-5ddd0d89-e52d-4e2e-89e3-cd5e367c5ba2 service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received unexpected event network-vif-plugged-b467529d-8282-454a-bfe1-c9d6e4f9780a for instance with vm_state building and task_state spawning.
Nov 10 16:36:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrsHNuOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:36:02 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:36:02 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:36:02 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9fc89d-6302-41fa-9b0a-d146d16ad610]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:36:02 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f8afb2d-46f9-412c-be7d-c085a1c0ca9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef] added
Nov 10 16:36:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[51386483-5823-4749-a0b4-1dcbf498d35a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0484471-ef0c-44d8-b1d6-4c6aa6a66839]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrsHNuOC {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XrsHNuOC" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96ea1bc-8c88-494b-adba-48295c87ebb4]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XrsHNuOC'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[27364157-142f-46b8-b952-c8ec71469239]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[db516513-71b3-48af-b871-7bf6488e066d]: (4, ('tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:36:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsi session list stdout=tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:36:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c38eada-e805-4896-bcc8-dc4480a7e9be]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef, portal: 172.16.0.220,3260]
Nov 10 16:36:02 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef, portal: 172.16.0.220,3260] successful.
Nov 10 16:36:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.045s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c6c914b-4e73-4ef4-bff8-be04ef073235]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a230e1-d68f-4384-8002-f8ef34b2e91b]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef (non-flash)
Nov 10 16:36:02 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:36:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef (non-flash)
Nov 10 16:36:02 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:36:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.318s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac29600-9646-4c09-a051-39bf552a3f00]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:36:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:36:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Instance spawned successfully.
Nov 10 16:36:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-3a6eb70f-c3e0-4448-80ca-4f44c9d02103 req-b582289d-f9d8-44de-93cf-756d742b8b83 service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received event network-vif-plugged-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3a6eb70f-c3e0-4448-80ca-4f44c9d02103 req-b582289d-f9d8-44de-93cf-756d742b8b83 service nova] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3a6eb70f-c3e0-4448-80ca-4f44c9d02103 req-b582289d-f9d8-44de-93cf-756d742b8b83 service nova] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3a6eb70f-c3e0-4448-80ca-4f44c9d02103 req-b582289d-f9d8-44de-93cf-756d742b8b83 service nova] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-3a6eb70f-c3e0-4448-80ca-4f44c9d02103 req-b582289d-f9d8-44de-93cf-756d742b8b83 service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] No waiting events found dispatching network-vif-plugged-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:36:03 user nova-compute[75102]: WARNING nova.compute.manager [req-3a6eb70f-c3e0-4448-80ca-4f44c9d02103 req-b582289d-f9d8-44de-93cf-756d742b8b83 service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received unexpected event network-vif-plugged-b467529d-8282-454a-bfe1-c9d6e4f9780a for instance with vm_state building and task_state spawning.
Nov 10 16:36:03 user nova-compute[75102]: INFO nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Took 6.95 seconds to spawn the instance on the hypervisor.
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:36:03 user nova-compute[75102]: INFO nova.compute.manager [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Took 7.71 seconds to build instance.
Nov 10 16:36:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-78ac9d0f-1df1-4d4a-9713-a0d88dbd9622 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.809s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrsHNuOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.354s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '23036326435393931', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036326435393931', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.objects.instance [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lazy-loading 'flavor' on Instance uuid c9348a9d-5891-40f6-96c7-e8c7179cf315 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:36:03 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:36:03 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:36:03 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:36:03 user nova-compute[75102]:   <serial>52df5f14-c03c-4bb4-a7a7-1311236efcef</serial>
Nov 10 16:36:03 user nova-compute[75102]: </disk>
Nov 10 16:36:03 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:36:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] No VIF found with MAC fa:16:3e:9e:78:6b, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-c37a3edc-4f79-4fab-b341-0874e8690e78 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.728s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:07 user nova-compute[75102]: INFO nova.compute.manager [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Detaching volume 52df5f14-c03c-4bb4-a7a7-1311236efcef
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.253s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:07 user nova-compute[75102]: INFO nova.virt.block_device [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Attempting to driver detach volume 52df5f14-c03c-4bb4-a7a7-1311236efcef from mountpoint /dev/vdb
Nov 10 16:36:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Attempting to detach device vdb from instance c9348a9d-5891-40f6-96c7-e8c7179cf315 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:36:07 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:36:07 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:36:07 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:36:07 user nova-compute[75102]:   <serial>52df5f14-c03c-4bb4-a7a7-1311236efcef</serial>
Nov 10 16:36:07 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:36:07 user nova-compute[75102]: </disk>
Nov 10 16:36:07 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:36:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Successfully detached device vdb from instance c9348a9d-5891-40f6-96c7-e8c7179cf315 from the persistent domain config.
Nov 10 16:36:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9348a9d-5891-40f6-96c7-e8c7179cf315 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:36:07 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:36:07 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:36:07 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:36:07 user nova-compute[75102]:   <serial>52df5f14-c03c-4bb4-a7a7-1311236efcef</serial>
Nov 10 16:36:07 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:36:07 user nova-compute[75102]: </disk>
Nov 10 16:36:07 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9348a9d-5891-40f6-96c7-e8c7179cf315 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:36:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:08 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:36:08 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7886MB free_disk=25.038307189941406GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 371a2928-c805-47e0-aeb8-e5140aac7b23 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 68e8fc6f-6d54-4804-b45c-4096f68a3894 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 66e94840-e8e6-4345-9a7a-927c16a54cdb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4011f0df-65d5-43a9-bc81-876e451a9095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updating instance_info_cache with network_info: [{"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-371a2928-c805-47e0-aeb8-e5140aac7b23" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:36:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:36:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:36:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:36:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:36:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:36:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:36:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:24 user nova-compute[75102]: INFO nova.compute.manager [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Terminating instance
Nov 10 16:36:24 user nova-compute[75102]: DEBUG nova.compute.manager [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-c945d7f2-8ae5-463d-bc0e-2d89ed03ced7 req-f69384f7-8a22-4ba8-8988-be1b27a5289d service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-unplugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c945d7f2-8ae5-463d-bc0e-2d89ed03ced7 req-f69384f7-8a22-4ba8-8988-be1b27a5289d service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c945d7f2-8ae5-463d-bc0e-2d89ed03ced7 req-f69384f7-8a22-4ba8-8988-be1b27a5289d service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c945d7f2-8ae5-463d-bc0e-2d89ed03ced7 req-f69384f7-8a22-4ba8-8988-be1b27a5289d service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-c945d7f2-8ae5-463d-bc0e-2d89ed03ced7 req-f69384f7-8a22-4ba8-8988-be1b27a5289d service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-unplugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-c945d7f2-8ae5-463d-bc0e-2d89ed03ced7 req-f69384f7-8a22-4ba8-8988-be1b27a5289d service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-unplugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:36:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:25 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Instance destroyed successfully.
Nov 10 16:36:25 user nova-compute[75102]: DEBUG nova.objects.instance [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'resources' on Instance uuid 371a2928-c805-47e0-aeb8-e5140aac7b23 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:18:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-736491098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-736491098',id=10,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:21:46Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-v0xb7v47',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:23:31Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=371a2928-c805-47e0-aeb8-e5140aac7b23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "address": "fa:16:3e:20:b9:c7", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8e334149-8b", "ovs_interfaceid": "8e334149-8bda-4d77-a44b-296a7ecf7a7d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:20:b9:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e334149-8bda-4d77-a44b-296a7ecf7a7d,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e334149-8b') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_vif [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:b9:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e334149-8bda-4d77-a44b-296a7ecf7a7d,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e334149-8b') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8e334149-8b, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=38600851-da06-4b8e-b6e5-ea60317258b9) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:36:25 user nova-compute[75102]: INFO os_vif [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:20:b9:c7,bridge_name='br-int',has_traffic_filtering=True,id=8e334149-8bda-4d77-a44b-296a7ecf7a7d,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8e334149-8b')
Nov 10 16:36:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EHzKvIqm', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:36:25 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d1d2291-54a3-44e9-8b9a-fd996b8116e5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:36:25 user nova-compute[75102]: No targets found.
Nov 10 16:36:25 user nova-compute[75102]: iSNS:
Nov 10 16:36:25 user nova-compute[75102]: No targets found.
Nov 10 16:36:25 user nova-compute[75102]: STATIC:
Nov 10 16:36:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef
Nov 10 16:36:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:36:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:36:25 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488
Nov 10 16:36:25 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:36:25 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:36:25 user nova-compute[75102]: FIRMWARE:
Nov 10 16:36:25 user nova-compute[75102]: No targets found.
Nov 10 16:36:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:36:25 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:36:25 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0cdaa5-8185-431c-88ca-2b764c9efb7b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a79baf-6dea-4912-b151-d4bb6a0bd8fb]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef (non-flash)
Nov 10 16:36:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:36:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef (non-flash)
Nov 10 16:36:25 user nova-compute[75102]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 (non-flash)
Nov 10 16:36:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f8435c8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ab36b1-e9da-484e-a06d-769a69133af5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b01f4e63-518c-4a8d-9fc4-d2abd4f393ec]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b0b716e-7862-46fa-aed7-68bf54ad8cf7]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.062s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[879052e6-3328-4204-a945-1e46f84e77ac]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d119bab-4227-422f-ac91-eea3759f90ab]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --logout" returned: 0 in 0.052s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a422301-a505-4cd5-91ca-c22b8bd18fdd]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488, portal: 172.16.0.220,3260]
Nov 10 16:36:25 user nova-compute[75102]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488, portal: 172.16.0.220,3260] successful.
Nov 10 16:36:25 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0c3a0a72-af1b-4b34-bdd7-127af133e488 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[12742437-0397-4c03-82da-fc2568e32c7a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] <== disconnect_volume: return (334ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:36:25 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Deleting instance files /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23_del
Nov 10 16:36:25 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Deletion of /opt/stack/data/nova/instances/371a2928-c805-47e0-aeb8-e5140aac7b23_del complete
Nov 10 16:36:25 user nova-compute[75102]: INFO nova.compute.manager [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Took 1.26 seconds to destroy the instance on the hypervisor.
Nov 10 16:36:25 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:36:25 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:36:26 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:36:26 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Took 0.72 seconds to deallocate network for instance.
Nov 10 16:36:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-a5f5fa74-63e8-4993-807b-115ff44df83b req-8d0fbad1-c931-4993-9ef8-04bea460de0a service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:36:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a5f5fa74-63e8-4993-807b-115ff44df83b req-8d0fbad1-c931-4993-9ef8-04bea460de0a service nova] Acquiring lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a5f5fa74-63e8-4993-807b-115ff44df83b req-8d0fbad1-c931-4993-9ef8-04bea460de0a service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a5f5fa74-63e8-4993-807b-115ff44df83b req-8d0fbad1-c931-4993-9ef8-04bea460de0a service nova] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-a5f5fa74-63e8-4993-807b-115ff44df83b req-8d0fbad1-c931-4993-9ef8-04bea460de0a service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] No waiting events found dispatching network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:36:26 user nova-compute[75102]: WARNING nova.compute.manager [req-a5f5fa74-63e8-4993-807b-115ff44df83b req-8d0fbad1-c931-4993-9ef8-04bea460de0a service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received unexpected event network-vif-plugged-8e334149-8bda-4d77-a44b-296a7ecf7a7d for instance with vm_state active and task_state deleting.
Nov 10 16:36:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-a5f5fa74-63e8-4993-807b-115ff44df83b req-8d0fbad1-c931-4993-9ef8-04bea460de0a service nova] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Received event network-vif-deleted-8e334149-8bda-4d77-a44b-296a7ecf7a7d {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:36:27 user nova-compute[75102]: INFO nova.compute.manager [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: 371a2928-c805-47e0-aeb8-e5140aac7b23] Took 1.24 seconds to detach 1 volumes for instance.
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:27 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9348a9d-5891-40f6-96c7-e8c7179cf315 is timed out.
Nov 10 16:36:27 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Successfully detached device vdb from instance c9348a9d-5891-40f6-96c7-e8c7179cf315 from the live domain config.
Nov 10 16:36:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XrsHNuOC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:36:27 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd275a39-f0f5-44f4-866a-3bc8ad5a9ac9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:36:27 user nova-compute[75102]: No targets found.
Nov 10 16:36:27 user nova-compute[75102]: iSNS:
Nov 10 16:36:27 user nova-compute[75102]: No targets found.
Nov 10 16:36:27 user nova-compute[75102]: STATIC:
Nov 10 16:36:27 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef
Nov 10 16:36:27 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:36:27 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:36:27 user nova-compute[75102]: FIRMWARE:
Nov 10 16:36:27 user nova-compute[75102]: No targets found.
Nov 10 16:36:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:36:27 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:36:27 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f028406c-861c-4d7b-93cb-9ee392e59d1a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ab9b5f-5b9f-409b-9cd0-b0fbbb5097c0]: (4, ('tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef (non-flash)
Nov 10 16:36:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsi session list stdout=tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef (non-flash)
Nov 10 16:36:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f544bfa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c0192c5-0dd2-4aac-9255-2e93ba70e7d0]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8c27ce2-681c-4b0b-8bad-5dff84091885]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[83478d67-72d1-415b-b6c4-d35c7ce2c987]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.356s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.049s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a3b6fc5-74fb-44bc-845c-e01b25ddbc1d]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:36:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d319770-df40-48d5-9621-338b3982bde1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:28 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Deleted allocations for instance 371a2928-c805-47e0-aeb8-e5140aac7b23
Nov 10 16:36:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[13ae0457-3edc-4a4e-9112-c428336390d6]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef, portal: 172.16.0.220,3260]
Nov 10 16:36:28 user nova-compute[75102]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef, portal: 172.16.0.220,3260] successful.
Nov 10 16:36:28 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:52df5f14-c03c-4bb4-a7a7-1311236efcef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4b249f0-4275-4201-8666-a2ec9a89751f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.339s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] <== disconnect_volume: return (340ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:36:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51fe60f2-6fff-4504-b576-3c68c48ea8cb tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "371a2928-c805-47e0-aeb8-e5140aac7b23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.806s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:29 user nova-compute[75102]: DEBUG nova.objects.instance [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lazy-loading 'flavor' on Instance uuid c9348a9d-5891-40f6-96c7-e8c7179cf315 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:36:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-734c92b4-156d-4005-a0e2-d84290487f6a tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.142s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "66e94840-e8e6-4345-9a7a-927c16a54cdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:50 user nova-compute[75102]: INFO nova.compute.manager [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Terminating instance
Nov 10 16:36:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-dc10f29d-c4cc-48c3-9d23-39a5779f150a req-c1b29070-5fb2-4bc4-a954-a48763d181b4 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received event network-vif-unplugged-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dc10f29d-c4cc-48c3-9d23-39a5779f150a req-c1b29070-5fb2-4bc4-a954-a48763d181b4 service nova] Acquiring lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dc10f29d-c4cc-48c3-9d23-39a5779f150a req-c1b29070-5fb2-4bc4-a954-a48763d181b4 service nova] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dc10f29d-c4cc-48c3-9d23-39a5779f150a req-c1b29070-5fb2-4bc4-a954-a48763d181b4 service nova] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-dc10f29d-c4cc-48c3-9d23-39a5779f150a req-c1b29070-5fb2-4bc4-a954-a48763d181b4 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] No waiting events found dispatching network-vif-unplugged-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-dc10f29d-c4cc-48c3-9d23-39a5779f150a req-c1b29070-5fb2-4bc4-a954-a48763d181b4 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received event network-vif-unplugged-f46df2df-479f-417e-a1df-120eb9c9fe33 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:36:51 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Instance destroyed successfully.
Nov 10 16:36:51 user nova-compute[75102]: DEBUG nova.objects.instance [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lazy-loading 'resources' on Instance uuid 66e94840-e8e6-4345-9a7a-927c16a54cdb {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:35:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2044120310',display_name='tempest-ServersNegativeTestJSON-server-2044120310',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2044120310',id=34,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:35:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='221beb548fbb455ca011f3a3fc7c4d34',ramdisk_id='',reservation_id='r-bfyrt4ga',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1842056783',owner_user_name='tempest-ServersNegativeTestJSON-1842056783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:35:09Z,user_data=None,user_id='a6ef288da57b4a26b32fd2d368fa85a6',uuid=66e94840-e8e6-4345-9a7a-927c16a54cdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converting VIF {"id": "f46df2df-479f-417e-a1df-120eb9c9fe33", "address": "fa:16:3e:a8:53:35", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf46df2df-47", "ovs_interfaceid": "f46df2df-479f-417e-a1df-120eb9c9fe33", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:53:35,bridge_name='br-int',has_traffic_filtering=True,id=f46df2df-479f-417e-a1df-120eb9c9fe33,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46df2df-47') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG os_vif [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:53:35,bridge_name='br-int',has_traffic_filtering=True,id=f46df2df-479f-417e-a1df-120eb9c9fe33,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46df2df-47') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf46df2df-47, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a0823bd0-c59f-4f1d-b274-5e2c80fd805f) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:36:51 user nova-compute[75102]: INFO os_vif [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:53:35,bridge_name='br-int',has_traffic_filtering=True,id=f46df2df-479f-417e-a1df-120eb9c9fe33,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf46df2df-47')
Nov 10 16:36:51 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Deleting instance files /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb_del
Nov 10 16:36:51 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Deletion of /opt/stack/data/nova/instances/66e94840-e8e6-4345-9a7a-927c16a54cdb_del complete
Nov 10 16:36:51 user nova-compute[75102]: INFO nova.compute.manager [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 16:36:51 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:36:51 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:36:52 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:36:52 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Took 0.43 seconds to deallocate network for instance.
Nov 10 16:36:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-85b2561d-1983-42b6-9f17-58f2d1048255 req-4329565f-d02e-45fe-9458-ff875ab8a187 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received event network-vif-deleted-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:36:52 user nova-compute[75102]: INFO nova.compute.manager [req-85b2561d-1983-42b6-9f17-58f2d1048255 req-4329565f-d02e-45fe-9458-ff875ab8a187 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Neutron deleted interface f46df2df-479f-417e-a1df-120eb9c9fe33; detaching it from the instance and deleting it from the info cache
Nov 10 16:36:52 user nova-compute[75102]: DEBUG nova.network.neutron [req-85b2561d-1983-42b6-9f17-58f2d1048255 req-4329565f-d02e-45fe-9458-ff875ab8a187 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:36:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-85b2561d-1983-42b6-9f17-58f2d1048255 req-4329565f-d02e-45fe-9458-ff875ab8a187 service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Detach interface failed, port_id=f46df2df-479f-417e-a1df-120eb9c9fe33, reason: Instance 66e94840-e8e6-4345-9a7a-927c16a54cdb could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:36:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:52 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:36:52 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:36:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.292s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:52 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Deleted allocations for instance 66e94840-e8e6-4345-9a7a-927c16a54cdb
Nov 10 16:36:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-e344ee04-ba3a-401c-9d6a-f4fa58776af9 tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.817s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:53 user nova-compute[75102]: DEBUG nova.compute.manager [req-eb83a6f1-c116-4795-ad44-febfc067e0ce req-f56ce7d4-c7af-470d-b841-83a22902d7ad service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received event network-vif-plugged-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:36:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb83a6f1-c116-4795-ad44-febfc067e0ce req-f56ce7d4-c7af-470d-b841-83a22902d7ad service nova] Acquiring lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:36:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb83a6f1-c116-4795-ad44-febfc067e0ce req-f56ce7d4-c7af-470d-b841-83a22902d7ad service nova] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:36:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb83a6f1-c116-4795-ad44-febfc067e0ce req-f56ce7d4-c7af-470d-b841-83a22902d7ad service nova] Lock "66e94840-e8e6-4345-9a7a-927c16a54cdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:36:53 user nova-compute[75102]: DEBUG nova.compute.manager [req-eb83a6f1-c116-4795-ad44-febfc067e0ce req-f56ce7d4-c7af-470d-b841-83a22902d7ad service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] No waiting events found dispatching network-vif-plugged-f46df2df-479f-417e-a1df-120eb9c9fe33 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:36:53 user nova-compute[75102]: WARNING nova.compute.manager [req-eb83a6f1-c116-4795-ad44-febfc067e0ce req-f56ce7d4-c7af-470d-b841-83a22902d7ad service nova] [instance: 66e94840-e8e6-4345-9a7a-927c16a54cdb] Received unexpected event network-vif-plugged-f46df2df-479f-417e-a1df-120eb9c9fe33 for instance with vm_state deleted and task_state None.
Nov 10 16:36:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:36:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:01 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:02 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:02 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:37:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:37:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7939MB free_disk=25.064964294433594GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 68e8fc6f-6d54-4804-b45c-4096f68a3894 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4011f0df-65d5-43a9-bc81-876e451a9095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:37:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:37:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 16:37:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 16:37:08 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:37:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 16:37:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 16:37:08 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:37:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:37:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:37:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.706s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:37:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:37:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:37:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:37:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updating instance_info_cache with network_info: [{"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:37:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:37:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:37:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:37:12 user nova-compute[75102]: INFO nova.compute.manager [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] instance snapshotting
Nov 10 16:37:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Beginning live snapshot process
Nov 10 16:37:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json -f qcow2 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json -f qcow2 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json -f qcow2" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.168s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvh442hmf/25271c047de14c90a22069f2fd5c8735.delta 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpvh442hmf/25271c047de14c90a22069f2fd5c8735.delta 1073741824" returned: 0 in 0.054s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:13 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 10 16:37:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 16:37:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 16:37:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 16:37:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:37:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] COPY block job progress, current cursor: 61997056 final cursor: 75563008 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:37:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75102) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 10 16:37:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 10 16:37:15 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvh442hmf/25271c047de14c90a22069f2fd5c8735.delta /opt/stack/data/nova/instances/snapshots/tmpvh442hmf/25271c047de14c90a22069f2fd5c8735 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:15 user nova-compute[75102]: INFO nova.compute.manager [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Terminating instance
Nov 10 16:37:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpvh442hmf/25271c047de14c90a22069f2fd5c8735.delta /opt/stack/data/nova/instances/snapshots/tmpvh442hmf/25271c047de14c90a22069f2fd5c8735" returned: 0 in 0.641s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Snapshot extracted, beginning image upload
Nov 10 16:37:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-1f71d793-232c-4f88-ae29-9f4900be2686 req-408ef058-23a8-4647-8d92-77a44208d8c9 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received event network-vif-unplugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1f71d793-232c-4f88-ae29-9f4900be2686 req-408ef058-23a8-4647-8d92-77a44208d8c9 service nova] Acquiring lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1f71d793-232c-4f88-ae29-9f4900be2686 req-408ef058-23a8-4647-8d92-77a44208d8c9 service nova] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1f71d793-232c-4f88-ae29-9f4900be2686 req-408ef058-23a8-4647-8d92-77a44208d8c9 service nova] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-1f71d793-232c-4f88-ae29-9f4900be2686 req-408ef058-23a8-4647-8d92-77a44208d8c9 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] No waiting events found dispatching network-vif-unplugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:37:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-1f71d793-232c-4f88-ae29-9f4900be2686 req-408ef058-23a8-4647-8d92-77a44208d8c9 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received event network-vif-unplugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:37:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Instance destroyed successfully.
Nov 10 16:37:16 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lazy-loading 'resources' on Instance uuid f11c84d6-ac5c-4301-b4e3-90fa5dc1e585 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:15:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1190915998',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1190915998',id=2,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:16:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c0e926f56f914e7488a50f5bb78a33cd',ramdisk_id='',reservation_id='r-256czwv7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-918868864',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:17:50Z,user_data=None,user_id='3149d0620bf64829aa4eec99a2cddee5',uuid=f11c84d6-ac5c-4301-b4e3-90fa5dc1e585,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converting VIF {"id": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "address": "fa:16:3e:48:d1:12", "network": {"id": "7333428d-c62d-4ff9-a3fa-4867b2654bd8", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-808574182-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c0e926f56f914e7488a50f5bb78a33cd", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap53486fff-1c", "ovs_interfaceid": "53486fff-1c8c-4c4b-b78c-2ef7deff3aec", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=53486fff-1c8c-4c4b-b78c-2ef7deff3aec,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53486fff-1c') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG os_vif [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=53486fff-1c8c-4c4b-b78c-2ef7deff3aec,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53486fff-1c') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53486fff-1c, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0264a573-950e-4142-b4f7-5fcf844fa62b) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:37:16 user nova-compute[75102]: INFO os_vif [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:d1:12,bridge_name='br-int',has_traffic_filtering=True,id=53486fff-1c8c-4c4b-b78c-2ef7deff3aec,network=Network(7333428d-c62d-4ff9-a3fa-4867b2654bd8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53486fff-1c')
Nov 10 16:37:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Deleting instance files /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585_del
Nov 10 16:37:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Deletion of /opt/stack/data/nova/instances/f11c84d6-ac5c-4301-b4e3-90fa5dc1e585_del complete
Nov 10 16:37:16 user nova-compute[75102]: INFO nova.compute.manager [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 16:37:16 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:16 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:16 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Took 0.47 seconds to deallocate network for instance.
Nov 10 16:37:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-c7050b64-4124-43f9-a3c5-e6a5288c4d15 req-85e5894f-367c-4715-b27c-f2840c105f7e service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received event network-vif-deleted-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.398s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:17 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Deleted allocations for instance f11c84d6-ac5c-4301-b4e3-90fa5dc1e585
Nov 10 16:37:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a6e5ab6b-a1d8-4b06-932b-2b85e4697c76 tempest-ServerBootFromVolumeStableRescueTest-918868864 tempest-ServerBootFromVolumeStableRescueTest-918868864-project-member] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.996s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-8a871515-8b3e-4e34-8eec-21026049a32b req-66fdc65b-ca08-4f42-b1b4-ddf780c8b183 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received event network-vif-plugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8a871515-8b3e-4e34-8eec-21026049a32b req-66fdc65b-ca08-4f42-b1b4-ddf780c8b183 service nova] Acquiring lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8a871515-8b3e-4e34-8eec-21026049a32b req-66fdc65b-ca08-4f42-b1b4-ddf780c8b183 service nova] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8a871515-8b3e-4e34-8eec-21026049a32b req-66fdc65b-ca08-4f42-b1b4-ddf780c8b183 service nova] Lock "f11c84d6-ac5c-4301-b4e3-90fa5dc1e585-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-8a871515-8b3e-4e34-8eec-21026049a32b req-66fdc65b-ca08-4f42-b1b4-ddf780c8b183 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] No waiting events found dispatching network-vif-plugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:37:17 user nova-compute[75102]: WARNING nova.compute.manager [req-8a871515-8b3e-4e34-8eec-21026049a32b req-66fdc65b-ca08-4f42-b1b4-ddf780c8b183 service nova] [instance: f11c84d6-ac5c-4301-b4e3-90fa5dc1e585] Received unexpected event network-vif-plugged-53486fff-1c8c-4c4b-b78c-2ef7deff3aec for instance with vm_state deleted and task_state None.
Nov 10 16:37:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Snapshot image upload complete
Nov 10 16:37:19 user nova-compute[75102]: INFO nova.compute.manager [None req-38e4026a-c1fb-4c6f-b6ac-1d6d92e73e81 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Took 6.76 seconds to snapshot the instance on the hypervisor.
Nov 10 16:37:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:20 user nova-compute[75102]: INFO nova.compute.manager [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Terminating instance
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-64230bae-caa1-4304-aa50-889339f339e3 req-4529d8e3-106c-4516-8f08-6eec06b8b6f2 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received event network-vif-unplugged-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-64230bae-caa1-4304-aa50-889339f339e3 req-4529d8e3-106c-4516-8f08-6eec06b8b6f2 service nova] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-64230bae-caa1-4304-aa50-889339f339e3 req-4529d8e3-106c-4516-8f08-6eec06b8b6f2 service nova] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-64230bae-caa1-4304-aa50-889339f339e3 req-4529d8e3-106c-4516-8f08-6eec06b8b6f2 service nova] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-64230bae-caa1-4304-aa50-889339f339e3 req-4529d8e3-106c-4516-8f08-6eec06b8b6f2 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] No waiting events found dispatching network-vif-unplugged-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-64230bae-caa1-4304-aa50-889339f339e3 req-4529d8e3-106c-4516-8f08-6eec06b8b6f2 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received event network-vif-unplugged-2eab767d-a59a-487a-9d00-839cb9f5f89a for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:37:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Instance destroyed successfully.
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.objects.instance [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'resources' on Instance uuid 68e8fc6f-6d54-4804-b45c-4096f68a3894 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:32:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1354456878',display_name='tempest-AttachVolumeNegativeTest-server-1354456878',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1354456878',id=31,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPQrhby4GVZ1t1sxulT6PA8X7EUrkwe/hyNYueQwQicRri8w0HAdkqmjanYUQhAri6K/0gT/qpuFZ7wEqlPjbi40uc2NmJPACd6BowizWXwstwmEm+y2pQ++XzjiPR/OZA==',key_name='tempest-keypair-1619472905',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:32:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-lf7hv5rt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:32:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=68e8fc6f-6d54-4804-b45c-4096f68a3894,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "address": "fa:16:3e:6e:36:9d", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.202", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2eab767d-a5", "ovs_interfaceid": "2eab767d-a59a-487a-9d00-839cb9f5f89a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6e:36:9d,bridge_name='br-int',has_traffic_filtering=True,id=2eab767d-a59a-487a-9d00-839cb9f5f89a,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab767d-a5') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG os_vif [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:36:9d,bridge_name='br-int',has_traffic_filtering=True,id=2eab767d-a59a-487a-9d00-839cb9f5f89a,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab767d-a5') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2eab767d-a5, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a96dba54-3b3b-45a8-8b43-63fe18d9eae2) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:21 user nova-compute[75102]: INFO os_vif [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6e:36:9d,bridge_name='br-int',has_traffic_filtering=True,id=2eab767d-a59a-487a-9d00-839cb9f5f89a,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2eab767d-a5')
Nov 10 16:37:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Deleting instance files /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894_del
Nov 10 16:37:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Deletion of /opt/stack/data/nova/instances/68e8fc6f-6d54-4804-b45c-4096f68a3894_del complete
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:37:21 user nova-compute[75102]: INFO nova.compute.manager [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 10 16:37:21 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:37:21 user nova-compute[75102]: INFO nova.compute.claims [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Claim successful on node user
Nov 10 16:37:22 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.423s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:37:22 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:37:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG nova.policy [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6794c1f412bb4fe1a9199c54acaf0f69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6dc60461b8e4239934a4dbba48519a7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:37:22 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Creating image(s)
Nov 10 16:37:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "/opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "/opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "/opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "22c5fec5db88402e0f8fac80930d1bfc2058eff6" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "22c5fec5db88402e0f8fac80930d1bfc2058eff6" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6.part --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Successfully created port: eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-074c91be-c7c2-45e8-81cd-869ac45b64a4 req-c3a9abea-f2fd-4378-aa2a-24f32b25bd56 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received event network-vif-deleted-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:23 user nova-compute[75102]: INFO nova.compute.manager [req-074c91be-c7c2-45e8-81cd-869ac45b64a4 req-c3a9abea-f2fd-4378-aa2a-24f32b25bd56 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Neutron deleted interface 2eab767d-a59a-487a-9d00-839cb9f5f89a; detaching it from the instance and deleting it from the info cache
Nov 10 16:37:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-074c91be-c7c2-45e8-81cd-869ac45b64a4 req-c3a9abea-f2fd-4378-aa2a-24f32b25bd56 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-bb998e9c-c931-4d6b-8772-79c60cf70bb5 req-b840764c-8399-4f47-b9cb-5ea2bacd09a1 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received event network-vif-plugged-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bb998e9c-c931-4d6b-8772-79c60cf70bb5 req-b840764c-8399-4f47-b9cb-5ea2bacd09a1 service nova] Acquiring lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bb998e9c-c931-4d6b-8772-79c60cf70bb5 req-b840764c-8399-4f47-b9cb-5ea2bacd09a1 service nova] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bb998e9c-c931-4d6b-8772-79c60cf70bb5 req-b840764c-8399-4f47-b9cb-5ea2bacd09a1 service nova] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-bb998e9c-c931-4d6b-8772-79c60cf70bb5 req-b840764c-8399-4f47-b9cb-5ea2bacd09a1 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] No waiting events found dispatching network-vif-plugged-2eab767d-a59a-487a-9d00-839cb9f5f89a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:37:23 user nova-compute[75102]: WARNING nova.compute.manager [req-bb998e9c-c931-4d6b-8772-79c60cf70bb5 req-b840764c-8399-4f47-b9cb-5ea2bacd09a1 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Received unexpected event network-vif-plugged-2eab767d-a59a-487a-9d00-839cb9f5f89a for instance with vm_state active and task_state deleting.
Nov 10 16:37:23 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:23 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Took 1.88 seconds to deallocate network for instance.
Nov 10 16:37:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-074c91be-c7c2-45e8-81cd-869ac45b64a4 req-c3a9abea-f2fd-4378-aa2a-24f32b25bd56 service nova] [instance: 68e8fc6f-6d54-4804-b45c-4096f68a3894] Detach interface failed, port_id=2eab767d-a59a-487a-9d00-839cb9f5f89a, reason: Instance 68e8fc6f-6d54-4804-b45c-4096f68a3894 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6.part --force-share --output=json" returned: 0 in 0.196s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG nova.virt.images [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] ef83d8d6-6b98-433a-a631-802b6ceebc2e was qcow2, converting to raw {{(pid=75102) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:37:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6.part /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6.converted {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:24 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:37:24 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:37:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.914s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:24 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Deleted allocations for instance 68e8fc6f-6d54-4804-b45c-4096f68a3894
Nov 10 16:37:24 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Successfully updated port: eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquired lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6.part /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6.converted" returned: 0 in 1.148s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6.converted --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-5f8337f7-1c62-4460-91cb-00fa5ee92247 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "68e8fc6f-6d54-4804-b45c-4096f68a3894" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.130s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6.converted --force-share --output=json" returned: 0 in 0.217s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "22c5fec5db88402e0f8fac80930d1bfc2058eff6" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.659s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6 --force-share --output=json" returned: 0 in 0.183s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "22c5fec5db88402e0f8fac80930d1bfc2058eff6" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "22c5fec5db88402e0f8fac80930d1bfc2058eff6" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Updating instance_info_cache with network_info: [{"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Releasing lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Instance network_info: |[{"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6 --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6,backing_fmt=raw /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6,backing_fmt=raw /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk 1073741824" returned: 0 in 0.059s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "22c5fec5db88402e0f8fac80930d1bfc2058eff6" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.258s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-11932015-ea31-429d-93e5-e991a9511b2f req-177871b8-7da6-4959-8117-2db492465c1e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received event network-changed-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-11932015-ea31-429d-93e5-e991a9511b2f req-177871b8-7da6-4959-8117-2db492465c1e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Refreshing instance network info cache due to event network-changed-eddf99a6-0587-4544-8b2d-8e89fd431141. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-11932015-ea31-429d-93e5-e991a9511b2f req-177871b8-7da6-4959-8117-2db492465c1e service nova] Acquiring lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-11932015-ea31-429d-93e5-e991a9511b2f req-177871b8-7da6-4959-8117-2db492465c1e service nova] Acquired lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.network.neutron [req-11932015-ea31-429d-93e5-e991a9511b2f req-177871b8-7da6-4959-8117-2db492465c1e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Refreshing network info cache for port eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6 --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Ensure instance console log exists: /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Start _get_guest_xml network_info=[{"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='a3d29f7a7317c057a1aff4f77999c4d6',container_format='bare',created_at=2023-11-10T16:37:12Z,direct_url=<?>,disk_format='qcow2',id=ef83d8d6-6b98-433a-a631-802b6ceebc2e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-292615121',owner='b6dc60461b8e4239934a4dbba48519a7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T16:37:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'ef83d8d6-6b98-433a-a631-802b6ceebc2e'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:37:25 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:37:25 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='a3d29f7a7317c057a1aff4f77999c4d6',container_format='bare',created_at=2023-11-10T16:37:12Z,direct_url=<?>,disk_format='qcow2',id=ef83d8d6-6b98-433a-a631-802b6ceebc2e,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-292615121',owner='b6dc60461b8e4239934a4dbba48519a7',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T16:37:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-295575412',display_name='tempest-TestStampPattern-server-295575412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-295575412',id=36,image_ref='ef83d8d6-6b98-433a-a631-802b6ceebc2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ8+LDBaM3IFKtZWt/WbN0wsXWTN3yBtKNBzWRh29A/ZPbyZyZTEWW+5+UGKfbdFjdDFqTq7gGbWdQpAbPZvSUbk8/mRUGgNL2pcc13I3ZIpl4yxUxyJFPJSb5GfPis2w==',key_name='tempest-TestStampPattern-81644141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6dc60461b8e4239934a4dbba48519a7',ramdisk_id='',reservation_id='r-60u47u01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c9348a9d-5891-40f6-96c7-e8c7179cf315',image_min_disk='1',image_min_ram='0',image_owner_id='b6dc60461b8e4239934a4dbba48519a7',image_owner_project_name='tempest-TestStampPattern-314715126',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-314715126-project-member',image_user_id='6794c1f412bb4fe1a9199c54acaf0f69',network_allocated='True',owner_project_name='tempest-TestStampPattern-314715126',owner_user_name='tempest-TestStampPattern-314715126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:37:23Z,user_data=None,user_id='6794c1f412bb4fe1a9199c54acaf0f69',uuid=3912f3a0-2c22-44cc-84c6-85b2c5d49ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converting VIF {"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:37:25 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:76,bridge_name='br-int',has_traffic_filtering=True,id=eddf99a6-0587-4544-8b2d-8e89fd431141,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeddf99a6-05') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG nova.objects.instance [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lazy-loading 'pci_devices' on Instance uuid 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:37:26 user nova-compute[75102]:   <uuid>3912f3a0-2c22-44cc-84c6-85b2c5d49ad9</uuid>
Nov 10 16:37:26 user nova-compute[75102]:   <name>instance-00000024</name>
Nov 10 16:37:26 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:37:26 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:37:26 user nova-compute[75102]:   <metadata>
Nov 10 16:37:26 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:37:26 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:37:26 user nova-compute[75102]:       <nova:name>tempest-TestStampPattern-server-295575412</nova:name>
Nov 10 16:37:26 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:37:25</nova:creationTime>
Nov 10 16:37:26 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:37:26 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:37:26 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:37:26 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:37:26 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:37:26 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:37:26 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:37:26 user nova-compute[75102]:       <nova:owner>
Nov 10 16:37:26 user nova-compute[75102]:         <nova:user uuid="6794c1f412bb4fe1a9199c54acaf0f69">tempest-TestStampPattern-314715126-project-member</nova:user>
Nov 10 16:37:26 user nova-compute[75102]:         <nova:project uuid="b6dc60461b8e4239934a4dbba48519a7">tempest-TestStampPattern-314715126</nova:project>
Nov 10 16:37:26 user nova-compute[75102]:       </nova:owner>
Nov 10 16:37:26 user nova-compute[75102]:       <nova:root type="image" uuid="ef83d8d6-6b98-433a-a631-802b6ceebc2e"/>
Nov 10 16:37:26 user nova-compute[75102]:       <nova:ports>
Nov 10 16:37:26 user nova-compute[75102]:         <nova:port uuid="eddf99a6-0587-4544-8b2d-8e89fd431141">
Nov 10 16:37:26 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 16:37:26 user nova-compute[75102]:         </nova:port>
Nov 10 16:37:26 user nova-compute[75102]:       </nova:ports>
Nov 10 16:37:26 user nova-compute[75102]:     </nova:instance>
Nov 10 16:37:26 user nova-compute[75102]:   </metadata>
Nov 10 16:37:26 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:37:26 user nova-compute[75102]:     <system>
Nov 10 16:37:26 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:37:26 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:37:26 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:37:26 user nova-compute[75102]:       <entry name="serial">3912f3a0-2c22-44cc-84c6-85b2c5d49ad9</entry>
Nov 10 16:37:26 user nova-compute[75102]:       <entry name="uuid">3912f3a0-2c22-44cc-84c6-85b2c5d49ad9</entry>
Nov 10 16:37:26 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:37:26 user nova-compute[75102]:     </system>
Nov 10 16:37:26 user nova-compute[75102]:   </sysinfo>
Nov 10 16:37:26 user nova-compute[75102]:   <os>
Nov 10 16:37:26 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:37:26 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:37:26 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:37:26 user nova-compute[75102]:   </os>
Nov 10 16:37:26 user nova-compute[75102]:   <features>
Nov 10 16:37:26 user nova-compute[75102]:     <acpi/>
Nov 10 16:37:26 user nova-compute[75102]:     <apic/>
Nov 10 16:37:26 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:37:26 user nova-compute[75102]:   </features>
Nov 10 16:37:26 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:37:26 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:37:26 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:37:26 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:37:26 user nova-compute[75102]:   </clock>
Nov 10 16:37:26 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:37:26 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:37:26 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:37:26 user nova-compute[75102]:   </cpu>
Nov 10 16:37:26 user nova-compute[75102]:   <devices>
Nov 10 16:37:26 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:37:26 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:37:26 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk"/>
Nov 10 16:37:26 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:37:26 user nova-compute[75102]:     </disk>
Nov 10 16:37:26 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:37:26 user nova-compute[75102]:       <mac address="fa:16:3e:dd:08:76"/>
Nov 10 16:37:26 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:37:26 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:37:26 user nova-compute[75102]:       <target dev="tapeddf99a6-05"/>
Nov 10 16:37:26 user nova-compute[75102]:     </interface>
Nov 10 16:37:26 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:37:26 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/console.log" append="off"/>
Nov 10 16:37:26 user nova-compute[75102]:     </serial>
Nov 10 16:37:26 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:37:26 user nova-compute[75102]:     <video>
Nov 10 16:37:26 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:37:26 user nova-compute[75102]:     </video>
Nov 10 16:37:26 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:37:26 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:37:26 user nova-compute[75102]:     </rng>
Nov 10 16:37:26 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:37:26 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:37:26 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:37:26 user nova-compute[75102]:     </memballoon>
Nov 10 16:37:26 user nova-compute[75102]:   </devices>
Nov 10 16:37:26 user nova-compute[75102]: </domain>
Nov 10 16:37:26 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-295575412',display_name='tempest-TestStampPattern-server-295575412',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-295575412',id=36,image_ref='ef83d8d6-6b98-433a-a631-802b6ceebc2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ8+LDBaM3IFKtZWt/WbN0wsXWTN3yBtKNBzWRh29A/ZPbyZyZTEWW+5+UGKfbdFjdDFqTq7gGbWdQpAbPZvSUbk8/mRUGgNL2pcc13I3ZIpl4yxUxyJFPJSb5GfPis2w==',key_name='tempest-TestStampPattern-81644141',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6dc60461b8e4239934a4dbba48519a7',ramdisk_id='',reservation_id='r-60u47u01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c9348a9d-5891-40f6-96c7-e8c7179cf315',image_min_disk='1',image_min_ram='0',image_owner_id='b6dc60461b8e4239934a4dbba48519a7',image_owner_project_name='tempest-TestStampPattern-314715126',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-314715126-project-member',image_user_id='6794c1f412bb4fe1a9199c54acaf0f69',network_allocated='True',owner_project_name='tempest-TestStampPattern-314715126',owner_user_name='tempest-TestStampPattern-314715126-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:37:23Z,user_data=None,user_id='6794c1f412bb4fe1a9199c54acaf0f69',uuid=3912f3a0-2c22-44cc-84c6-85b2c5d49ad9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converting VIF {"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:76,bridge_name='br-int',has_traffic_filtering=True,id=eddf99a6-0587-4544-8b2d-8e89fd431141,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeddf99a6-05') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG os_vif [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:76,bridge_name='br-int',has_traffic_filtering=True,id=eddf99a6-0587-4544-8b2d-8e89fd431141,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeddf99a6-05') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5015cc7c-374c-5be1-b18e-0af6ba2bba1b', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeddf99a6-05, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapeddf99a6-05, col_values=(('qos', UUID('b21f41b3-9760-44e3-859e-1fd2fd757583')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapeddf99a6-05, col_values=(('external_ids', {'iface-id': 'eddf99a6-0587-4544-8b2d-8e89fd431141', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:dd:08:76', 'vm-uuid': '3912f3a0-2c22-44cc-84c6-85b2c5d49ad9'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:26 user nova-compute[75102]: INFO os_vif [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:dd:08:76,bridge_name='br-int',has_traffic_filtering=True,id=eddf99a6-0587-4544-8b2d-8e89fd431141,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeddf99a6-05')
Nov 10 16:37:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] No VIF found with MAC fa:16:3e:dd:08:76, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG nova.network.neutron [req-11932015-ea31-429d-93e5-e991a9511b2f req-177871b8-7da6-4959-8117-2db492465c1e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Updated VIF entry in instance network info cache for port eddf99a6-0587-4544-8b2d-8e89fd431141. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG nova.network.neutron [req-11932015-ea31-429d-93e5-e991a9511b2f req-177871b8-7da6-4959-8117-2db492465c1e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Updating instance_info_cache with network_info: [{"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-11932015-ea31-429d-93e5-e991a9511b2f req-177871b8-7da6-4959-8117-2db492465c1e service nova] Releasing lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:37:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:27 user nova-compute[75102]: DEBUG nova.compute.manager [req-3fe41ccc-65a4-4a59-809d-d917ff6453c8 req-b78eff3c-f039-478b-baae-13669047885c service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received event network-vif-plugged-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3fe41ccc-65a4-4a59-809d-d917ff6453c8 req-b78eff3c-f039-478b-baae-13669047885c service nova] Acquiring lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3fe41ccc-65a4-4a59-809d-d917ff6453c8 req-b78eff3c-f039-478b-baae-13669047885c service nova] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3fe41ccc-65a4-4a59-809d-d917ff6453c8 req-b78eff3c-f039-478b-baae-13669047885c service nova] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:27 user nova-compute[75102]: DEBUG nova.compute.manager [req-3fe41ccc-65a4-4a59-809d-d917ff6453c8 req-b78eff3c-f039-478b-baae-13669047885c service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] No waiting events found dispatching network-vif-plugged-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:37:27 user nova-compute[75102]: WARNING nova.compute.manager [req-3fe41ccc-65a4-4a59-809d-d917ff6453c8 req-b78eff3c-f039-478b-baae-13669047885c service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received unexpected event network-vif-plugged-eddf99a6-0587-4544-8b2d-8e89fd431141 for instance with vm_state building and task_state spawning.
Nov 10 16:37:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-c06dd16b-6d9f-4462-aaca-fc5a6f08350c req-9429435d-5a3d-4f4c-93b5-1bfaf9dc5dbb service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received event network-vif-plugged-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c06dd16b-6d9f-4462-aaca-fc5a6f08350c req-9429435d-5a3d-4f4c-93b5-1bfaf9dc5dbb service nova] Acquiring lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c06dd16b-6d9f-4462-aaca-fc5a6f08350c req-9429435d-5a3d-4f4c-93b5-1bfaf9dc5dbb service nova] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c06dd16b-6d9f-4462-aaca-fc5a6f08350c req-9429435d-5a3d-4f4c-93b5-1bfaf9dc5dbb service nova] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG nova.compute.manager [req-c06dd16b-6d9f-4462-aaca-fc5a6f08350c req-9429435d-5a3d-4f4c-93b5-1bfaf9dc5dbb service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] No waiting events found dispatching network-vif-plugged-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:37:29 user nova-compute[75102]: WARNING nova.compute.manager [req-c06dd16b-6d9f-4462-aaca-fc5a6f08350c req-9429435d-5a3d-4f4c-93b5-1bfaf9dc5dbb service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received unexpected event network-vif-plugged-eddf99a6-0587-4544-8b2d-8e89fd431141 for instance with vm_state building and task_state spawning.
Nov 10 16:37:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:37:29 user nova-compute[75102]: INFO nova.compute.claims [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Claim successful on node user
Nov 10 16:37:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:37:29 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Instance spawned successfully.
Nov 10 16:37:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:37:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:37:30 user nova-compute[75102]: INFO nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Took 7.38 seconds to spawn the instance on the hypervisor.
Nov 10 16:37:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:37:30 user nova-compute[75102]: INFO nova.compute.manager [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Took 8.22 seconds to build instance.
Nov 10 16:37:30 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0b07fd02-030f-42d0-8743-0d7e66904d7c tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.368s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.404s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:37:30 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:37:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG nova.policy [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7bbea9eecf0b4e998ad458bc0d30a5bf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46f5704b433744dd8188e61d576dd461', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:37:30 user nova-compute[75102]: INFO nova.virt.block_device [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Booting with volume ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 at /dev/vda
Nov 10 16:37:30 user nova-compute[75102]: DEBUG os_brick.utils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab7b61a-623d-4200-b454-73a751fd6aeb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ca5c777-496a-41f4-9eb1-3075d215a9f0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5ca4505-2971-4be5-9532-298b6c58ef45]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7615d5-93d4-45ec-9926-a6ecf1b502d5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:37:30 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:37:30 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5f2d41-a2ff-4bc7-b239-12d3ac3f1ae4]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG os_brick.utils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:37:30 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating existing volume attachment record: 55bdc474-8e80-4dc9-940a-e9cc759f1814 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:37:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:31 user nova-compute[75102]: DEBUG nova.network.neutron [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Successfully created port: 7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG nova.network.neutron [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Successfully updated port: 7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquired lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG nova.network.neutron [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG nova.network.neutron [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-f8f57250-0267-41d8-aad7-6888d12772e9 req-87f59d25-ed65-410f-b52f-e956a01c3a84 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-changed-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-f8f57250-0267-41d8-aad7-6888d12772e9 req-87f59d25-ed65-410f-b52f-e956a01c3a84 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Refreshing instance network info cache due to event network-changed-7530f992-ba56-418f-abbe-0e16fe005dfb. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f8f57250-0267-41d8-aad7-6888d12772e9 req-87f59d25-ed65-410f-b52f-e956a01c3a84 service nova] Acquiring lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG nova.network.neutron [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating instance_info_cache with network_info: [{"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Releasing lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Instance network_info: |[{"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f8f57250-0267-41d8-aad7-6888d12772e9 req-87f59d25-ed65-410f-b52f-e956a01c3a84 service nova] Acquired lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:37:32 user nova-compute[75102]: DEBUG nova.network.neutron [req-f8f57250-0267-41d8-aad7-6888d12772e9 req-87f59d25-ed65-410f-b52f-e956a01c3a84 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Refreshing network info cache for port 7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:37:33 user nova-compute[75102]: DEBUG nova.network.neutron [req-f8f57250-0267-41d8-aad7-6888d12772e9 req-87f59d25-ed65-410f-b52f-e956a01c3a84 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updated VIF entry in instance network info cache for port 7530f992-ba56-418f-abbe-0e16fe005dfb. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:37:33 user nova-compute[75102]: DEBUG nova.network.neutron [req-f8f57250-0267-41d8-aad7-6888d12772e9 req-87f59d25-ed65-410f-b52f-e956a01c3a84 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating instance_info_cache with network_info: [{"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f8f57250-0267-41d8-aad7-6888d12772e9 req-87f59d25-ed65-410f-b52f-e956a01c3a84 service nova] Releasing lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:37:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:37:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:37:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:37:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:37:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:37:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:37:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:37:42 user nova-compute[75102]: INFO nova.compute.claims [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Claim successful on node user
Nov 10 16:37:42 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.325s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG nova.network.neutron [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:37:42 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:37:42 user nova-compute[75102]: DEBUG nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:37:42 user nova-compute[75102]: DEBUG nova.policy [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96544e5daa74d51a232f565129b328a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3cd7409a94429d9262ef8a2a664d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:37:42 user nova-compute[75102]: INFO nova.virt.block_device [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Booting with volume snapshot 7041fe1c-1ca3-4274-a87d-4ce080809fbb at /dev/vda
Nov 10 16:37:43 user nova-compute[75102]: DEBUG nova.network.neutron [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Successfully created port: 79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.network.neutron [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Successfully updated port: 79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "refresh_cache-3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquired lock "refresh_cache-3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.network.neutron [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-2a89875a-9c06-46e4-8660-1819d523bae9 req-0610b81d-9da4-4805-8dad-e50fda77ee85 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-changed-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.compute.manager [req-2a89875a-9c06-46e4-8660-1819d523bae9 req-0610b81d-9da4-4805-8dad-e50fda77ee85 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Refreshing instance network info cache due to event network-changed-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2a89875a-9c06-46e4-8660-1819d523bae9 req-0610b81d-9da4-4805-8dad-e50fda77ee85 service nova] Acquiring lock "refresh_cache-3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.network.neutron [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.network.neutron [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Updating instance_info_cache with network_info: [{"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Releasing lock "refresh_cache-3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Instance network_info: |[{"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2a89875a-9c06-46e4-8660-1819d523bae9 req-0610b81d-9da4-4805-8dad-e50fda77ee85 service nova] Acquired lock "refresh_cache-3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-2a89875a-9c06-46e4-8660-1819d523bae9 req-0610b81d-9da4-4805-8dad-e50fda77ee85 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Refreshing network info cache for port 79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-2a89875a-9c06-46e4-8660-1819d523bae9 req-0610b81d-9da4-4805-8dad-e50fda77ee85 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Updated VIF entry in instance network info cache for port 79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG nova.network.neutron [req-2a89875a-9c06-46e4-8660-1819d523bae9 req-0610b81d-9da4-4805-8dad-e50fda77ee85 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Updating instance_info_cache with network_info: [{"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2a89875a-9c06-46e4-8660-1819d523bae9 req-0610b81d-9da4-4805-8dad-e50fda77ee85 service nova] Releasing lock "refresh_cache-3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:37:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:46 user nova-compute[75102]: DEBUG nova.compute.manager [req-9ba043b4-9fc2-4d2b-b9c2-2d08a9ce45c8 req-cc277b0d-ac0f-410d-bea5-c6af5e83853e service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received event network-changed-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:37:46 user nova-compute[75102]: DEBUG nova.compute.manager [req-9ba043b4-9fc2-4d2b-b9c2-2d08a9ce45c8 req-cc277b0d-ac0f-410d-bea5-c6af5e83853e service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Refreshing instance network info cache due to event network-changed-b467529d-8282-454a-bfe1-c9d6e4f9780a. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:37:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9ba043b4-9fc2-4d2b-b9c2-2d08a9ce45c8 req-cc277b0d-ac0f-410d-bea5-c6af5e83853e service nova] Acquiring lock "refresh_cache-4011f0df-65d5-43a9-bc81-876e451a9095" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:37:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9ba043b4-9fc2-4d2b-b9c2-2d08a9ce45c8 req-cc277b0d-ac0f-410d-bea5-c6af5e83853e service nova] Acquired lock "refresh_cache-4011f0df-65d5-43a9-bc81-876e451a9095" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:37:46 user nova-compute[75102]: DEBUG nova.network.neutron [req-9ba043b4-9fc2-4d2b-b9c2-2d08a9ce45c8 req-cc277b0d-ac0f-410d-bea5-c6af5e83853e service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Refreshing network info cache for port b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:37:47 user nova-compute[75102]: DEBUG nova.network.neutron [req-9ba043b4-9fc2-4d2b-b9c2-2d08a9ce45c8 req-cc277b0d-ac0f-410d-bea5-c6af5e83853e service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Updated VIF entry in instance network info cache for port b467529d-8282-454a-bfe1-c9d6e4f9780a. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:37:47 user nova-compute[75102]: DEBUG nova.network.neutron [req-9ba043b4-9fc2-4d2b-b9c2-2d08a9ce45c8 req-cc277b0d-ac0f-410d-bea5-c6af5e83853e service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Updating instance_info_cache with network_info: [{"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:37:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9ba043b4-9fc2-4d2b-b9c2-2d08a9ce45c8 req-cc277b0d-ac0f-410d-bea5-c6af5e83853e service nova] Releasing lock "refresh_cache-4011f0df-65d5-43a9-bc81-876e451a9095" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:37:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:47 user nova-compute[75102]: DEBUG nova.objects.instance [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'flavor' on Instance uuid 4011f0df-65d5-43a9-bc81-876e451a9095 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:37:48 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Ignoring supplied device name: /dev/vdb
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:37:48 user nova-compute[75102]: INFO nova.compute.manager [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Attaching volume 8575017f-6d0b-4a41-8883-acedde608735 to /dev/vdb
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.utils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03477aa-73ba-4121-ab10-0b39b2a709c5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[88bcca86-045b-4aca-83b9-a73199a44b56]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[17732bab-8973-4c35-b4b0-0620b7a8de8a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa67d3e-92c8-40b2-ab50-b0eece0d22c6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:37:48 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f048cf1-0f72-4af2-b5aa-0735456e06c4]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.utils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Updating existing volume attachment record: cf0f66dc-5928-4b5c-8d2d-db030b0f39c9 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.utils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ebd4593-d149-476a-b059-eb5a1eb43ce4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba3e59ec-3fec-46fc-ac9c-5e5878867eb9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e0d8ed-1107-45a7-9a89-ad7909ef3103]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6b2fe6-8002-488f-919d-ddbc5e1ee962]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:37:48 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:37:48 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[64eb682c-e269-4c08-800b-e7cd3c39bddc]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG os_brick.utils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:37:48 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Updating existing volume attachment record: f5a7c657-9eb9-4247-8110-815e1d8e7f86 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:37:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:37:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:02 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.254s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:38:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8118MB free_disk=25.061676025390625GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4011f0df-65d5-43a9-bc81-876e451a9095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance da5d6c88-342c-423d-b0f4-5a18774e91f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:38:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.473s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:38:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Creating image(s)
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Ensure instance console log exists: /opt/stack/data/nova/instances/da5d6c88-342c-423d-b0f4-5a18774e91f4/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Start _get_guest_xml network_info=[{"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '55bdc474-8e80-4dc9-940a-e9cc759f1814', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYAhnOwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'da5d6c88-342c-423d-b0f4-5a18774e91f4', 'attached_at': '', 'detached_at': '', 'volume_id': 'ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'serial': 'ad91eebd-e6b0-4f8f-a4ef-5055932f8a24'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:38:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:38:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYAhnOwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:38:09 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:38:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:38:09 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:38:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:38:09 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[09d510ce-0d4b-4460-bec2-348942ddec38]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:38:09 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42abb5a-8031-44fb-a6f8-c0d074290afb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24] added
Nov 10 16:38:09 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cf3108-c14f-403c-a922-37aef7ac610c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc67076-39b4-4f39-b5fd-64c7d72ce2a6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sYAhnOwR {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sYAhnOwR" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f79735f-14d7-4938-925c-c54ef2b65a50]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sYAhnOwR'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Updating instance_info_cache with network_info: [{"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.128s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5598571a-2cc1-44b7-b7d9-ccc318203e5f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea77efb6-788d-4977-91bf-cb60c4d6acde]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:38:10 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:38:10 user nova-compute[75102]:  {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:38:10 user nova-compute[75102]: WARNING os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 16:38:10 user nova-compute[75102]: 
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[baae517d-5a57-4c1f-854f-210737c7003f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260]
Nov 10 16:38:10 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260] successful.
Nov 10 16:38:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbc511e-e5c7-4e27-bd0c-84ee6cc0e9d0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[72621fbe-539c-4b2d-8f53-d97866e3f9be]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.450s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] HCTL ('33', '-', '-', 0) found on session 31 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ebbcb0-6b93-4f0b-8158-e1861bc9b02c]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching for a device in session 31 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYAhnOwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.485s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== connect_volume: return (1486ms) {'type': 'block', 'scsi_wwn': '23038343533666662', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038343533666662', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1390976736',display_name='tempest-ServerActionsTestOtherA-server-1390976736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1390976736',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJIyuW1YgII5m42ZzPQI/sKQHH3q65mUxP8WzQFSf/4n/JTQ1Wu3opROEkHOGysy1Wt2WY0dRoS8kKXFZZja/7C79VSuXQ0L9aJFgTEonW/PDJXKdDwWpg0JM1ZatQvbg==',key_name='tempest-keypair-394571970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-s4xfkfdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:37:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=da5d6c88-342c-423d-b0f4-5a18774e91f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.objects.instance [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'pci_devices' on Instance uuid da5d6c88-342c-423d-b0f4-5a18774e91f4 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:38:11 user nova-compute[75102]:   <uuid>da5d6c88-342c-423d-b0f4-5a18774e91f4</uuid>
Nov 10 16:38:11 user nova-compute[75102]:   <name>instance-00000025</name>
Nov 10 16:38:11 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:38:11 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:38:11 user nova-compute[75102]:   <metadata>
Nov 10 16:38:11 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:38:11 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:38:11 user nova-compute[75102]:       <nova:name>tempest-ServerActionsTestOtherA-server-1390976736</nova:name>
Nov 10 16:38:11 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:38:09</nova:creationTime>
Nov 10 16:38:11 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:38:11 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:38:11 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:38:11 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:38:11 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:38:11 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:38:11 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:38:11 user nova-compute[75102]:       <nova:owner>
Nov 10 16:38:11 user nova-compute[75102]:         <nova:user uuid="7bbea9eecf0b4e998ad458bc0d30a5bf">tempest-ServerActionsTestOtherA-1931720116-project-member</nova:user>
Nov 10 16:38:11 user nova-compute[75102]:         <nova:project uuid="46f5704b433744dd8188e61d576dd461">tempest-ServerActionsTestOtherA-1931720116</nova:project>
Nov 10 16:38:11 user nova-compute[75102]:       </nova:owner>
Nov 10 16:38:11 user nova-compute[75102]:       <nova:ports>
Nov 10 16:38:11 user nova-compute[75102]:         <nova:port uuid="7530f992-ba56-418f-abbe-0e16fe005dfb">
Nov 10 16:38:11 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:38:11 user nova-compute[75102]:         </nova:port>
Nov 10 16:38:11 user nova-compute[75102]:       </nova:ports>
Nov 10 16:38:11 user nova-compute[75102]:     </nova:instance>
Nov 10 16:38:11 user nova-compute[75102]:   </metadata>
Nov 10 16:38:11 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:38:11 user nova-compute[75102]:     <system>
Nov 10 16:38:11 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:38:11 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:38:11 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:38:11 user nova-compute[75102]:       <entry name="serial">da5d6c88-342c-423d-b0f4-5a18774e91f4</entry>
Nov 10 16:38:11 user nova-compute[75102]:       <entry name="uuid">da5d6c88-342c-423d-b0f4-5a18774e91f4</entry>
Nov 10 16:38:11 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:38:11 user nova-compute[75102]:     </system>
Nov 10 16:38:11 user nova-compute[75102]:   </sysinfo>
Nov 10 16:38:11 user nova-compute[75102]:   <os>
Nov 10 16:38:11 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:38:11 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:38:11 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:38:11 user nova-compute[75102]:   </os>
Nov 10 16:38:11 user nova-compute[75102]:   <features>
Nov 10 16:38:11 user nova-compute[75102]:     <acpi/>
Nov 10 16:38:11 user nova-compute[75102]:     <apic/>
Nov 10 16:38:11 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:38:11 user nova-compute[75102]:   </features>
Nov 10 16:38:11 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:38:11 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:38:11 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:38:11 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:38:11 user nova-compute[75102]:   </clock>
Nov 10 16:38:11 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:38:11 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:38:11 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:38:11 user nova-compute[75102]:   </cpu>
Nov 10 16:38:11 user nova-compute[75102]:   <devices>
Nov 10 16:38:11 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:38:11 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:38:11 user nova-compute[75102]:       <source dev="/dev/sdb"/>
Nov 10 16:38:11 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:38:11 user nova-compute[75102]:       <serial>ad91eebd-e6b0-4f8f-a4ef-5055932f8a24</serial>
Nov 10 16:38:11 user nova-compute[75102]:     </disk>
Nov 10 16:38:11 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:38:11 user nova-compute[75102]:       <mac address="fa:16:3e:73:47:f7"/>
Nov 10 16:38:11 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:38:11 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:38:11 user nova-compute[75102]:       <target dev="tap7530f992-ba"/>
Nov 10 16:38:11 user nova-compute[75102]:     </interface>
Nov 10 16:38:11 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:38:11 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/da5d6c88-342c-423d-b0f4-5a18774e91f4/console.log" append="off"/>
Nov 10 16:38:11 user nova-compute[75102]:     </serial>
Nov 10 16:38:11 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:38:11 user nova-compute[75102]:     <video>
Nov 10 16:38:11 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:38:11 user nova-compute[75102]:     </video>
Nov 10 16:38:11 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:38:11 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:38:11 user nova-compute[75102]:     </rng>
Nov 10 16:38:11 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:38:11 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:38:11 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:38:11 user nova-compute[75102]:     </memballoon>
Nov 10 16:38:11 user nova-compute[75102]:   </devices>
Nov 10 16:38:11 user nova-compute[75102]: </domain>
Nov 10 16:38:11 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1390976736',display_name='tempest-ServerActionsTestOtherA-server-1390976736',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1390976736',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJIyuW1YgII5m42ZzPQI/sKQHH3q65mUxP8WzQFSf/4n/JTQ1Wu3opROEkHOGysy1Wt2WY0dRoS8kKXFZZja/7C79VSuXQ0L9aJFgTEonW/PDJXKdDwWpg0JM1ZatQvbg==',key_name='tempest-keypair-394571970',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-s4xfkfdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:37:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=da5d6c88-342c-423d-b0f4-5a18774e91f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG os_vif [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9b78867-3f7e-53e6-ad67-3bf1e5994f24', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7530f992-ba, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7530f992-ba, col_values=(('qos', UUID('6166957a-e6e9-40e4-9253-958c1928d869')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7530f992-ba, col_values=(('external_ids', {'iface-id': '7530f992-ba56-418f-abbe-0e16fe005dfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:47:f7', 'vm-uuid': 'da5d6c88-342c-423d-b0f4-5a18774e91f4'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:11 user nova-compute[75102]: INFO os_vif [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba')
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:38:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No VIF found with MAC fa:16:3e:73:47:f7, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJAfHUNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:38:12 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:38:12 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:38:12 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b700ae-50d3-48da-b044-2a73ac03dc59]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:38:12 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b45e61-b254-4e1d-9e87-1f36dea69c42]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735] added
Nov 10 16:38:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d9bae6-3eb7-4c7c-83f0-b2ac8c0b6170]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ba6bf4-5c35-4b60-9893-ae041ccc24c3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJAfHUNY {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GJAfHUNY" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd42fe5d-056f-47ab-8011-f04260eab591]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GJAfHUNY'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dfc3bdd-2583-4c1c-a4e3-d642744aa33f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[646e1833-dfad-48a2-8d6a-9e5d584aa732]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d112e4d-2754-4b63-a72f-294fd5447f9f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735, portal: 172.16.0.220,3260]
Nov 10 16:38:13 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735, portal: 172.16.0.220,3260] successful.
Nov 10 16:38:13 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73cbabc-368f-4fe8-a615-55a2d1d81fe8]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6db044d1-20f7-4293-b7ef-7cc88c930e85]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:13 user nova-compute[75102]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:38:13 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:13 user nova-compute[75102]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:38:13 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] HCTL ('34', '-', '-', 0) found on session 32 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b28830ae-51f9-42d6-b88c-0ca5c4c4791d]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Searching for a device in session 32 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJAfHUNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-53aad3dc-b556-48a8-9462-c2b62fa66fb6 req-04d9d0c9-5f7c-403e-9f7a-6bc653ca7d8f service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-53aad3dc-b556-48a8-9462-c2b62fa66fb6 req-04d9d0c9-5f7c-403e-9f7a-6bc653ca7d8f service nova] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-53aad3dc-b556-48a8-9462-c2b62fa66fb6 req-04d9d0c9-5f7c-403e-9f7a-6bc653ca7d8f service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-53aad3dc-b556-48a8-9462-c2b62fa66fb6 req-04d9d0c9-5f7c-403e-9f7a-6bc653ca7d8f service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-53aad3dc-b556-48a8-9462-c2b62fa66fb6 req-04d9d0c9-5f7c-403e-9f7a-6bc653ca7d8f service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] No waiting events found dispatching network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:38:13 user nova-compute[75102]: WARNING nova.compute.manager [req-53aad3dc-b556-48a8-9462-c2b62fa66fb6 req-04d9d0c9-5f7c-403e-9f7a-6bc653ca7d8f service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received unexpected event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb for instance with vm_state building and task_state spawning.
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:38:13 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Creating image(s)
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Ensure instance console log exists: /opt/stack/data/nova/instances/3cbb3485-343d-46e0-a9e2-5bbcb5f4971e/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Start _get_guest_xml network_info=[{"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f5a7c657-9eb9-4247-8110-815e1d8e7f86', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOqSKyIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3cbb3485-343d-46e0-a9e2-5bbcb5f4971e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f406dff4-5b39-4686-b89f-39954802fea7', 'serial': 'f406dff4-5b39-4686-b89f-39954802fea7'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:38:13 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:38:13 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOqSKyIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:38:13 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:38:13 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26337653939656637', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26337653939656637', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.212s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:38:14 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:38:14 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG nova.objects.instance [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'flavor' on Instance uuid 4011f0df-65d5-43a9-bc81-876e451a9095 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[506947c4-8632-47aa-9f08-bb95975331f6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:38:14 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:38:14 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:38:14 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:38:14 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:38:14 user nova-compute[75102]:   <serial>8575017f-6d0b-4a41-8883-acedde608735</serial>
Nov 10 16:38:14 user nova-compute[75102]: </disk>
Nov 10 16:38:14 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a874c1-3ece-48d3-90b3-b864b193312e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7] added
Nov 10 16:38:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d495b97c-2982-4b48-aaa7-73226f952913]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3617ff33-f388-4cf1-a908-ec3de1487603]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOqSKyIb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FOqSKyIb" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ddd7c37-da42-48b5-8fb5-c9d134870bd8]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FOqSKyIb'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[33d47027-ead8-4f13-a27a-6a8d026322fe]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a975ec2-60f9-49bf-b0cb-bbe657361143]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bb760e-f27a-4975-8aa0-a543da976bc3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7, portal: 172.16.0.220,3260]
Nov 10 16:38:14 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7, portal: 172.16.0.220,3260] successful.
Nov 10 16:38:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2fda1ed-efba-4546-9719-18adcfd90a29]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac737822-895e-45af-a0ae-2ef9cfe2c82e]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 (non-flash)
Nov 10 16:38:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] HCTL ('35', '-', '-', 0) found on session 33 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce74deda-7103-4403-82be-400de02b5748]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching for a device in session 33 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOqSKyIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No VIF found with MAC fa:16:3e:08:4b:7d, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:38:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-bcf7fa95-867b-468b-bab9-27c4f1068342 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.639s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:38:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Instance spawned successfully.
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:38:15 user nova-compute[75102]: INFO nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Took 5.62 seconds to spawn the instance on the hypervisor.
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-36dcead5-130b-4cca-9b3f-84e1e70508d1 req-a3276aca-a963-4065-b8d7-1430ef63034b service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-36dcead5-130b-4cca-9b3f-84e1e70508d1 req-a3276aca-a963-4065-b8d7-1430ef63034b service nova] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-36dcead5-130b-4cca-9b3f-84e1e70508d1 req-a3276aca-a963-4065-b8d7-1430ef63034b service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-36dcead5-130b-4cca-9b3f-84e1e70508d1 req-a3276aca-a963-4065-b8d7-1430ef63034b service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-36dcead5-130b-4cca-9b3f-84e1e70508d1 req-a3276aca-a963-4065-b8d7-1430ef63034b service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] No waiting events found dispatching network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:38:15 user nova-compute[75102]: WARNING nova.compute.manager [req-36dcead5-130b-4cca-9b3f-84e1e70508d1 req-a3276aca-a963-4065-b8d7-1430ef63034b service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received unexpected event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb for instance with vm_state building and task_state spawning.
Nov 10 16:38:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.369s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== connect_volume: return (1581ms) {'type': 'block', 'scsi_wwn': '23466633938346633', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23466633938346633', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:38:15 user nova-compute[75102]: INFO nova.compute.claims [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Claim successful on node user
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1486306092',display_name='tempest-TestVolumeBootPattern-server-1486306092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1486306092',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-h6aswgr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:37:43Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=3cbb3485-343d-46e0-a9e2-5bbcb5f4971e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:62:90,bridge_name='br-int',has_traffic_filtering=True,id=79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79bd2c0c-6a') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'pci_devices' on Instance uuid 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:38:15 user nova-compute[75102]: INFO nova.compute.manager [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Took 45.76 seconds to build instance.
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:38:15 user nova-compute[75102]:   <uuid>3cbb3485-343d-46e0-a9e2-5bbcb5f4971e</uuid>
Nov 10 16:38:15 user nova-compute[75102]:   <name>instance-00000026</name>
Nov 10 16:38:15 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:38:15 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:38:15 user nova-compute[75102]:   <metadata>
Nov 10 16:38:15 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:38:15 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:38:15 user nova-compute[75102]:       <nova:name>tempest-TestVolumeBootPattern-server-1486306092</nova:name>
Nov 10 16:38:15 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:38:13</nova:creationTime>
Nov 10 16:38:15 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:38:15 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:38:15 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:38:15 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:38:15 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:38:15 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:38:15 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:38:15 user nova-compute[75102]:       <nova:owner>
Nov 10 16:38:15 user nova-compute[75102]:         <nova:user uuid="e96544e5daa74d51a232f565129b328a">tempest-TestVolumeBootPattern-1535704831-project-member</nova:user>
Nov 10 16:38:15 user nova-compute[75102]:         <nova:project uuid="fe3cd7409a94429d9262ef8a2a664d7c">tempest-TestVolumeBootPattern-1535704831</nova:project>
Nov 10 16:38:15 user nova-compute[75102]:       </nova:owner>
Nov 10 16:38:15 user nova-compute[75102]:       <nova:ports>
Nov 10 16:38:15 user nova-compute[75102]:         <nova:port uuid="79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf">
Nov 10 16:38:15 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 16:38:15 user nova-compute[75102]:         </nova:port>
Nov 10 16:38:15 user nova-compute[75102]:       </nova:ports>
Nov 10 16:38:15 user nova-compute[75102]:     </nova:instance>
Nov 10 16:38:15 user nova-compute[75102]:   </metadata>
Nov 10 16:38:15 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:38:15 user nova-compute[75102]:     <system>
Nov 10 16:38:15 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:38:15 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:38:15 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:38:15 user nova-compute[75102]:       <entry name="serial">3cbb3485-343d-46e0-a9e2-5bbcb5f4971e</entry>
Nov 10 16:38:15 user nova-compute[75102]:       <entry name="uuid">3cbb3485-343d-46e0-a9e2-5bbcb5f4971e</entry>
Nov 10 16:38:15 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:38:15 user nova-compute[75102]:     </system>
Nov 10 16:38:15 user nova-compute[75102]:   </sysinfo>
Nov 10 16:38:15 user nova-compute[75102]:   <os>
Nov 10 16:38:15 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:38:15 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:38:15 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:38:15 user nova-compute[75102]:   </os>
Nov 10 16:38:15 user nova-compute[75102]:   <features>
Nov 10 16:38:15 user nova-compute[75102]:     <acpi/>
Nov 10 16:38:15 user nova-compute[75102]:     <apic/>
Nov 10 16:38:15 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:38:15 user nova-compute[75102]:   </features>
Nov 10 16:38:15 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:38:15 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:38:15 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:38:15 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:38:15 user nova-compute[75102]:   </clock>
Nov 10 16:38:15 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:38:15 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:38:15 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:38:15 user nova-compute[75102]:   </cpu>
Nov 10 16:38:15 user nova-compute[75102]:   <devices>
Nov 10 16:38:15 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:38:15 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:38:15 user nova-compute[75102]:       <source dev="/dev/sdd"/>
Nov 10 16:38:15 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:38:15 user nova-compute[75102]:       <serial>f406dff4-5b39-4686-b89f-39954802fea7</serial>
Nov 10 16:38:15 user nova-compute[75102]:     </disk>
Nov 10 16:38:15 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:38:15 user nova-compute[75102]:       <mac address="fa:16:3e:d9:62:90"/>
Nov 10 16:38:15 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:38:15 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:38:15 user nova-compute[75102]:       <target dev="tap79bd2c0c-6a"/>
Nov 10 16:38:15 user nova-compute[75102]:     </interface>
Nov 10 16:38:15 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:38:15 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/3cbb3485-343d-46e0-a9e2-5bbcb5f4971e/console.log" append="off"/>
Nov 10 16:38:15 user nova-compute[75102]:     </serial>
Nov 10 16:38:15 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:38:15 user nova-compute[75102]:     <video>
Nov 10 16:38:15 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:38:15 user nova-compute[75102]:     </video>
Nov 10 16:38:15 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:38:15 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:38:15 user nova-compute[75102]:     </rng>
Nov 10 16:38:15 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:38:15 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:38:15 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:38:15 user nova-compute[75102]:     </memballoon>
Nov 10 16:38:15 user nova-compute[75102]:   </devices>
Nov 10 16:38:15 user nova-compute[75102]: </domain>
Nov 10 16:38:15 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1486306092',display_name='tempest-TestVolumeBootPattern-server-1486306092',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1486306092',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-h6aswgr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:37:43Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=3cbb3485-343d-46e0-a9e2-5bbcb5f4971e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:62:90,bridge_name='br-int',has_traffic_filtering=True,id=79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79bd2c0c-6a') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG os_vif [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:62:90,bridge_name='br-int',has_traffic_filtering=True,id=79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79bd2c0c-6a') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '625e59e8-6d65-5af4-b1e5-da2b7bb4ac24', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-172186b4-aeec-4ffb-b07a-06d635cc53d0 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 45.904s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79bd2c0c-6a, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79bd2c0c-6a, col_values=(('qos', UUID('f3cdc753-232b-4357-a1d8-8b2744bbf4d1')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79bd2c0c-6a, col_values=(('external_ids', {'iface-id': '79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:62:90', 'vm-uuid': '3cbb3485-343d-46e0-a9e2-5bbcb5f4971e'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:15 user nova-compute[75102]: INFO os_vif [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:62:90,bridge_name='br-int',has_traffic_filtering=True,id=79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79bd2c0c-6a')
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No VIF found with MAC fa:16:3e:d9:62:90, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:38:15 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:38:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:38:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG nova.policy [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e290c40d1bac47f9aa06185efefbb4bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6e388a924d2546fabfefe82c241ecbb1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:38:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Creating image(s)
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "/opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "/opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "/opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.237s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.194s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk 1073741824" returned: 0 in 0.072s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.277s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Successfully created port: b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Cannot resize image /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Ensure instance console log exists: /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-00fb62ba-0086-440b-8836-ac39bb2ad849 req-16a66b36-1fca-497b-a429-df65d36ee598 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-00fb62ba-0086-440b-8836-ac39bb2ad849 req-16a66b36-1fca-497b-a429-df65d36ee598 service nova] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-00fb62ba-0086-440b-8836-ac39bb2ad849 req-16a66b36-1fca-497b-a429-df65d36ee598 service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-00fb62ba-0086-440b-8836-ac39bb2ad849 req-16a66b36-1fca-497b-a429-df65d36ee598 service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-00fb62ba-0086-440b-8836-ac39bb2ad849 req-16a66b36-1fca-497b-a429-df65d36ee598 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] No waiting events found dispatching network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:38:17 user nova-compute[75102]: WARNING nova.compute.manager [req-00fb62ba-0086-440b-8836-ac39bb2ad849 req-16a66b36-1fca-497b-a429-df65d36ee598 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received unexpected event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf for instance with vm_state building and task_state spawning.
Nov 10 16:38:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Successfully updated port: b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "refresh_cache-0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquired lock "refresh_cache-0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-519f9525-fc76-4e4c-86df-6d6d29cb0ddc req-771f645e-c8bd-494b-8c81-d2283bbbe7bd service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received event network-changed-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-519f9525-fc76-4e4c-86df-6d6d29cb0ddc req-771f645e-c8bd-494b-8c81-d2283bbbe7bd service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Refreshing instance network info cache due to event network-changed-b53fde8e-547c-4e1c-af0a-d3f4108b146f. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-519f9525-fc76-4e4c-86df-6d6d29cb0ddc req-771f645e-c8bd-494b-8c81-d2283bbbe7bd service nova] Acquiring lock "refresh_cache-0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Updating instance_info_cache with network_info: [{"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Releasing lock "refresh_cache-0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Instance network_info: |[{"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-519f9525-fc76-4e4c-86df-6d6d29cb0ddc req-771f645e-c8bd-494b-8c81-d2283bbbe7bd service nova] Acquired lock "refresh_cache-0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-519f9525-fc76-4e4c-86df-6d6d29cb0ddc req-771f645e-c8bd-494b-8c81-d2283bbbe7bd service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Refreshing network info cache for port b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Start _get_guest_xml network_info=[{"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:38:18 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:38:18 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-225540388',display_name='tempest-AttachVolumeNegativeTest-server-225540388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-225540388',id=39,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK13XLuGYbxuREuBn5qBwiCoZef0tiQYRhmFgxBhmq7WshPhZoHgOwDuvDZdXsuA9m8GAPuTJvGSWyTMhoM0yibhacqFGqKjbmg/10VmOlOM6kjodGct95qT69f/GYFRMQ==',key_name='tempest-keypair-1089500709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-rdr0u09h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:38:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=0a2899c4-fca3-4f7b-bffd-7642b9abfbe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=b53fde8e-547c-4e1c-af0a-d3f4108b146f,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53fde8e-54') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.objects.instance [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'pci_devices' on Instance uuid 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:38:18 user nova-compute[75102]:   <uuid>0a2899c4-fca3-4f7b-bffd-7642b9abfbe6</uuid>
Nov 10 16:38:18 user nova-compute[75102]:   <name>instance-00000027</name>
Nov 10 16:38:18 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:38:18 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:38:18 user nova-compute[75102]:   <metadata>
Nov 10 16:38:18 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:38:18 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:38:18 user nova-compute[75102]:       <nova:name>tempest-AttachVolumeNegativeTest-server-225540388</nova:name>
Nov 10 16:38:18 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:38:18</nova:creationTime>
Nov 10 16:38:18 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:38:18 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:38:18 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:38:18 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:38:18 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:38:18 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:38:18 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:38:18 user nova-compute[75102]:       <nova:owner>
Nov 10 16:38:18 user nova-compute[75102]:         <nova:user uuid="e290c40d1bac47f9aa06185efefbb4bd">tempest-AttachVolumeNegativeTest-1745402198-project-member</nova:user>
Nov 10 16:38:18 user nova-compute[75102]:         <nova:project uuid="6e388a924d2546fabfefe82c241ecbb1">tempest-AttachVolumeNegativeTest-1745402198</nova:project>
Nov 10 16:38:18 user nova-compute[75102]:       </nova:owner>
Nov 10 16:38:18 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:38:18 user nova-compute[75102]:       <nova:ports>
Nov 10 16:38:18 user nova-compute[75102]:         <nova:port uuid="b53fde8e-547c-4e1c-af0a-d3f4108b146f">
Nov 10 16:38:18 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 10 16:38:18 user nova-compute[75102]:         </nova:port>
Nov 10 16:38:18 user nova-compute[75102]:       </nova:ports>
Nov 10 16:38:18 user nova-compute[75102]:     </nova:instance>
Nov 10 16:38:18 user nova-compute[75102]:   </metadata>
Nov 10 16:38:18 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:38:18 user nova-compute[75102]:     <system>
Nov 10 16:38:18 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:38:18 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:38:18 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:38:18 user nova-compute[75102]:       <entry name="serial">0a2899c4-fca3-4f7b-bffd-7642b9abfbe6</entry>
Nov 10 16:38:18 user nova-compute[75102]:       <entry name="uuid">0a2899c4-fca3-4f7b-bffd-7642b9abfbe6</entry>
Nov 10 16:38:18 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:38:18 user nova-compute[75102]:     </system>
Nov 10 16:38:18 user nova-compute[75102]:   </sysinfo>
Nov 10 16:38:18 user nova-compute[75102]:   <os>
Nov 10 16:38:18 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:38:18 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:38:18 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:38:18 user nova-compute[75102]:   </os>
Nov 10 16:38:18 user nova-compute[75102]:   <features>
Nov 10 16:38:18 user nova-compute[75102]:     <acpi/>
Nov 10 16:38:18 user nova-compute[75102]:     <apic/>
Nov 10 16:38:18 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:38:18 user nova-compute[75102]:   </features>
Nov 10 16:38:18 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:38:18 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:38:18 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:38:18 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:38:18 user nova-compute[75102]:   </clock>
Nov 10 16:38:18 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:38:18 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:38:18 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:38:18 user nova-compute[75102]:   </cpu>
Nov 10 16:38:18 user nova-compute[75102]:   <devices>
Nov 10 16:38:18 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:38:18 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:38:18 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk"/>
Nov 10 16:38:18 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:38:18 user nova-compute[75102]:     </disk>
Nov 10 16:38:18 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:38:18 user nova-compute[75102]:       <mac address="fa:16:3e:d8:8a:cb"/>
Nov 10 16:38:18 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:38:18 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:38:18 user nova-compute[75102]:       <target dev="tapb53fde8e-54"/>
Nov 10 16:38:18 user nova-compute[75102]:     </interface>
Nov 10 16:38:18 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:38:18 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/console.log" append="off"/>
Nov 10 16:38:18 user nova-compute[75102]:     </serial>
Nov 10 16:38:18 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:38:18 user nova-compute[75102]:     <video>
Nov 10 16:38:18 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:38:18 user nova-compute[75102]:     </video>
Nov 10 16:38:18 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:38:18 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:38:18 user nova-compute[75102]:     </rng>
Nov 10 16:38:18 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:38:18 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:38:18 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:38:18 user nova-compute[75102]:     </memballoon>
Nov 10 16:38:18 user nova-compute[75102]:   </devices>
Nov 10 16:38:18 user nova-compute[75102]: </domain>
Nov 10 16:38:18 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-225540388',display_name='tempest-AttachVolumeNegativeTest-server-225540388',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-225540388',id=39,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK13XLuGYbxuREuBn5qBwiCoZef0tiQYRhmFgxBhmq7WshPhZoHgOwDuvDZdXsuA9m8GAPuTJvGSWyTMhoM0yibhacqFGqKjbmg/10VmOlOM6kjodGct95qT69f/GYFRMQ==',key_name='tempest-keypair-1089500709',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-rdr0u09h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:38:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=0a2899c4-fca3-4f7b-bffd-7642b9abfbe6,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=b53fde8e-547c-4e1c-af0a-d3f4108b146f,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53fde8e-54') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG os_vif [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=b53fde8e-547c-4e1c-af0a-d3f4108b146f,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53fde8e-54') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '243daaee-6cd8-5d19-b6f8-cf9dfb135a05', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb53fde8e-54, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb53fde8e-54, col_values=(('qos', UUID('016b0d20-feac-408b-8055-26a684f10f68')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb53fde8e-54, col_values=(('external_ids', {'iface-id': 'b53fde8e-547c-4e1c-af0a-d3f4108b146f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d8:8a:cb', 'vm-uuid': '0a2899c4-fca3-4f7b-bffd-7642b9abfbe6'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:18 user nova-compute[75102]: INFO os_vif [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d8:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=b53fde8e-547c-4e1c-af0a-d3f4108b146f,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53fde8e-54')
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No VIF found with MAC fa:16:3e:d8:8a:cb, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-519f9525-fc76-4e4c-86df-6d6d29cb0ddc req-771f645e-c8bd-494b-8c81-d2283bbbe7bd service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Updated VIF entry in instance network info cache for port b53fde8e-547c-4e1c-af0a-d3f4108b146f. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-519f9525-fc76-4e4c-86df-6d6d29cb0ddc req-771f645e-c8bd-494b-8c81-d2283bbbe7bd service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Updating instance_info_cache with network_info: [{"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:38:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-519f9525-fc76-4e4c-86df-6d6d29cb0ddc req-771f645e-c8bd-494b-8c81-d2283bbbe7bd service nova] Releasing lock "refresh_cache-0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-eb680080-240b-4b55-978b-1ef6550292a6 req-24cc66e3-a8d1-45b3-a4ca-cdb984287d8a service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb680080-240b-4b55-978b-1ef6550292a6 req-24cc66e3-a8d1-45b3-a4ca-cdb984287d8a service nova] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb680080-240b-4b55-978b-1ef6550292a6 req-24cc66e3-a8d1-45b3-a4ca-cdb984287d8a service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb680080-240b-4b55-978b-1ef6550292a6 req-24cc66e3-a8d1-45b3-a4ca-cdb984287d8a service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-eb680080-240b-4b55-978b-1ef6550292a6 req-24cc66e3-a8d1-45b3-a4ca-cdb984287d8a service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] No waiting events found dispatching network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:38:19 user nova-compute[75102]: WARNING nova.compute.manager [req-eb680080-240b-4b55-978b-1ef6550292a6 req-24cc66e3-a8d1-45b3-a4ca-cdb984287d8a service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received unexpected event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf for instance with vm_state building and task_state spawning.
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:38:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Instance spawned successfully.
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:19 user nova-compute[75102]: INFO nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 10 16:38:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:38:19 user nova-compute[75102]: INFO nova.compute.manager [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Took 37.32 seconds to build instance.
Nov 10 16:38:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-37842b01-3010-4459-843a-fecbbb0c33c1 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 37.428s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received event network-vif-plugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:38:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] No waiting events found dispatching network-vif-plugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:38:21 user nova-compute[75102]: WARNING nova.compute.manager [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received unexpected event network-vif-plugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f for instance with vm_state building and task_state spawning.
Nov 10 16:38:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received event network-vif-plugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:38:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:38:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:38:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] No waiting events found dispatching network-vif-plugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:38:21 user nova-compute[75102]: WARNING nova.compute.manager [req-1c865c50-cffb-4da0-afc3-8898fe25303e req-8aec699f-e137-43eb-9944-a53e5ead6ec5 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received unexpected event network-vif-plugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f for instance with vm_state building and task_state spawning.
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:38:22 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Instance spawned successfully.
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:38:22 user nova-compute[75102]: INFO nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Took 6.72 seconds to spawn the instance on the hypervisor.
Nov 10 16:38:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:38:23 user nova-compute[75102]: INFO nova.compute.manager [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Took 7.63 seconds to build instance.
Nov 10 16:38:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4d0fd930-1de8-4fd7-a1f2-a24eed40c955 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.730s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:38:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:38:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:38:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:39:04 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:39:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:05 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:39:05 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:39:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:39:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7609MB free_disk=25.018280029296875GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4011f0df-65d5-43a9-bc81-876e451a9095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance da5d6c88-342c-423d-b0f4-5a18774e91f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:39:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.535s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:11 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:39:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:39:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:39:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:39:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:39:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updating instance_info_cache with network_info: [{"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:39:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:39:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:39:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:39:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:39:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-a4085050-2608-4882-bf8c-a05e3173d318 req-4b0ee4a7-1b42-4b1c-bd1a-f118a883330e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received event network-changed-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-a4085050-2608-4882-bf8c-a05e3173d318 req-4b0ee4a7-1b42-4b1c-bd1a-f118a883330e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Refreshing instance network info cache due to event network-changed-eddf99a6-0587-4544-8b2d-8e89fd431141. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a4085050-2608-4882-bf8c-a05e3173d318 req-4b0ee4a7-1b42-4b1c-bd1a-f118a883330e service nova] Acquiring lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a4085050-2608-4882-bf8c-a05e3173d318 req-4b0ee4a7-1b42-4b1c-bd1a-f118a883330e service nova] Acquired lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-a4085050-2608-4882-bf8c-a05e3173d318 req-4b0ee4a7-1b42-4b1c-bd1a-f118a883330e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Refreshing network info cache for port eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-a4085050-2608-4882-bf8c-a05e3173d318 req-4b0ee4a7-1b42-4b1c-bd1a-f118a883330e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Updated VIF entry in instance network info cache for port eddf99a6-0587-4544-8b2d-8e89fd431141. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-a4085050-2608-4882-bf8c-a05e3173d318 req-4b0ee4a7-1b42-4b1c-bd1a-f118a883330e service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Updating instance_info_cache with network_info: [{"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a4085050-2608-4882-bf8c-a05e3173d318 req-4b0ee4a7-1b42-4b1c-bd1a-f118a883330e service nova] Releasing lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG nova.objects.instance [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lazy-loading 'flavor' on Instance uuid 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:39:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.056s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:14 user nova-compute[75102]: INFO nova.compute.manager [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Attaching volume 7d6afae8-61c4-4d1a-ae1a-6c6886393dcf to /dev/vdb
Nov 10 16:39:14 user nova-compute[75102]: DEBUG os_brick.utils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aa1d79f-74d4-454a-860a-aaae053d7bf3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e38f6a7a-1a46-4677-8aaa-2af7dfc6e5c0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a84037fc-25d5-4a63-bb3f-beeb85dbff16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab905299-bb9b-46da-8482-490785a6e2e5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:39:14 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[19fa475b-aabf-4657-9cb9-9a44435210db]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG os_brick.utils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Updating existing volume attachment record: 3fc79b83-9993-4776-a2d1-5e083028bf7d {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:39:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:39:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c3431ad-8a45-42f1-937c-3d3246d236bd req-c48f13dd-afc8-4c68-bee8-bf4b33bbefef service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Received event network-changed-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-1c3431ad-8a45-42f1-937c-3d3246d236bd req-c48f13dd-afc8-4c68-bee8-bf4b33bbefef service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Refreshing instance network info cache due to event network-changed-9cb73dcc-ebbc-40a9-8375-49e8fd739c07. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:39:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c3431ad-8a45-42f1-937c-3d3246d236bd req-c48f13dd-afc8-4c68-bee8-bf4b33bbefef service nova] Acquiring lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:39:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c3431ad-8a45-42f1-937c-3d3246d236bd req-c48f13dd-afc8-4c68-bee8-bf4b33bbefef service nova] Acquired lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:39:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-1c3431ad-8a45-42f1-937c-3d3246d236bd req-c48f13dd-afc8-4c68-bee8-bf4b33bbefef service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Refreshing network info cache for port 9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:39:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-1c3431ad-8a45-42f1-937c-3d3246d236bd req-c48f13dd-afc8-4c68-bee8-bf4b33bbefef service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updated VIF entry in instance network info cache for port 9cb73dcc-ebbc-40a9-8375-49e8fd739c07. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:39:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-1c3431ad-8a45-42f1-937c-3d3246d236bd req-c48f13dd-afc8-4c68-bee8-bf4b33bbefef service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updating instance_info_cache with network_info: [{"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:39:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1c3431ad-8a45-42f1-937c-3d3246d236bd req-c48f13dd-afc8-4c68-bee8-bf4b33bbefef service nova] Releasing lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Stashing vm_state: active {{(pid=75102) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:39:22 user nova-compute[75102]: INFO nova.compute.claims [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Claim successful on node user
Nov 10 16:39:22 user nova-compute[75102]: INFO nova.compute.resource_tracker [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating resource usage from migration e8fa2133-07a8-4ddc-8979-fc2d3db675e7
Nov 10 16:39:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-ac426515-383a-4d72-9f47-b43b096fbe6e req-06b1fb72-005e-4d8e-9be4-bb3248173328 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-changed-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-ac426515-383a-4d72-9f47-b43b096fbe6e req-06b1fb72-005e-4d8e-9be4-bb3248173328 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Refreshing instance network info cache due to event network-changed-7530f992-ba56-418f-abbe-0e16fe005dfb. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ac426515-383a-4d72-9f47-b43b096fbe6e req-06b1fb72-005e-4d8e-9be4-bb3248173328 service nova] Acquiring lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ac426515-383a-4d72-9f47-b43b096fbe6e req-06b1fb72-005e-4d8e-9be4-bb3248173328 service nova] Acquired lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG nova.network.neutron [req-ac426515-383a-4d72-9f47-b43b096fbe6e req-06b1fb72-005e-4d8e-9be4-bb3248173328 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Refreshing network info cache for port 7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:39:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.436s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:22 user nova-compute[75102]: INFO nova.compute.manager [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Migrating
Nov 10 16:39:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-ac426515-383a-4d72-9f47-b43b096fbe6e req-06b1fb72-005e-4d8e-9be4-bb3248173328 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updated VIF entry in instance network info cache for port 7530f992-ba56-418f-abbe-0e16fe005dfb. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-ac426515-383a-4d72-9f47-b43b096fbe6e req-06b1fb72-005e-4d8e-9be4-bb3248173328 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating instance_info_cache with network_info: [{"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ac426515-383a-4d72-9f47-b43b096fbe6e req-06b1fb72-005e-4d8e-9be4-bb3248173328 service nova] Releasing lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquired lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG nova.network.neutron [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG nova.network.neutron [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating instance_info_cache with network_info: [{"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Releasing lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Starting migrate_disk_and_power_off {{(pid=75102) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-144933b7-0d0f-44cf-9c1f-5ffba569eec6 req-6863d801-efce-4f23-806a-8e84946c1cd1 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-unplugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-144933b7-0d0f-44cf-9c1f-5ffba569eec6 req-6863d801-efce-4f23-806a-8e84946c1cd1 service nova] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-144933b7-0d0f-44cf-9c1f-5ffba569eec6 req-6863d801-efce-4f23-806a-8e84946c1cd1 service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-144933b7-0d0f-44cf-9c1f-5ffba569eec6 req-6863d801-efce-4f23-806a-8e84946c1cd1 service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-144933b7-0d0f-44cf-9c1f-5ffba569eec6 req-6863d801-efce-4f23-806a-8e84946c1cd1 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] No waiting events found dispatching network-vif-unplugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:24 user nova-compute[75102]: WARNING nova.compute.manager [req-144933b7-0d0f-44cf-9c1f-5ffba569eec6 req-6863d801-efce-4f23-806a-8e84946c1cd1 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received unexpected event network-vif-unplugged-7530f992-ba56-418f-abbe-0e16fe005dfb for instance with vm_state active and task_state resize_migrating.
Nov 10 16:39:24 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Instance destroyed successfully.
Nov 10 16:39:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1390976736',display_name='tempest-ServerActionsTestOtherA-server-1390976736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1390976736',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJIyuW1YgII5m42ZzPQI/sKQHH3q65mUxP8WzQFSf/4n/JTQ1Wu3opROEkHOGysy1Wt2WY0dRoS8kKXFZZja/7C79VSuXQ0L9aJFgTEonW/PDJXKdDwWpg0JM1ZatQvbg==',key_name='tempest-keypair-394571970',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:38:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-s4xfkfdf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=da5d6c88-342c-423d-b0f4-5a18774e91f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-197547384-network", "vif_mac": "fa:16:3e:73:47:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-197547384-network", "vif_mac": "fa:16:3e:73:47:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_vif [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7530f992-ba, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6166957a-e6e9-40e4-9253-958c1928d869) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:24 user nova-compute[75102]: INFO os_vif [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba')
Nov 10 16:39:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYAhnOwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:39:24 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3174b80-2620-4708-838b-76cc5c5703c7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:39:24 user nova-compute[75102]: No targets found.
Nov 10 16:39:24 user nova-compute[75102]: iSNS:
Nov 10 16:39:24 user nova-compute[75102]: No targets found.
Nov 10 16:39:24 user nova-compute[75102]: STATIC:
Nov 10 16:39:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735
Nov 10 16:39:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:39:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:39:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7
Nov 10 16:39:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:39:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:39:24 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24
Nov 10 16:39:24 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:39:24 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:39:24 user nova-compute[75102]: FIRMWARE:
Nov 10 16:39:24 user nova-compute[75102]: No targets found.
Nov 10 16:39:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:39:24 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:39:24 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ea7e26-6634-43c1-953e-3733befca99d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d981e03b-5add-4499-803c-d49577c8e832]: (4, ('tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:39:24 user nova-compute[75102]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:24 user nova-compute[75102]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 (non-flash)
Nov 10 16:39:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:39:24 user nova-compute[75102]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:24 user nova-compute[75102]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 (non-flash)
Nov 10 16:39:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7449f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[29089d86-3e13-4d87-bec8-f3028a8b71b5]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[13c7ad63-3c2d-4db7-996a-68a156f86807]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a4412ea-d451-4e63-9118-f086743f7e2f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d667f9c-1338-427e-814a-4afa1fedd16f]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23038343533666662', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_9af30b95', '/dev/disk/by-id/scsi-1SCST_BIO9af30b95-08453ffb7b1a3a8e') {{(pid=85940) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[546f095e-2b5f-4c13-85b9-37ea01ed8ae1]: (4, None) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f80d57d-a957-4781-bf92-bdf99ef7a93f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd1cb3d-9570-446d-955c-0a88f556e59e]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260]
Nov 10 16:39:24 user nova-compute[75102]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260] successful.
Nov 10 16:39:24 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d752b8e-e019-48c8-a102-f7f9129898b5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.321s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== disconnect_volume: return (323ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:39:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:39:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Port 7530f992-ba56-418f-abbe-0e16fe005dfb binding to destination host user is already ACTIVE {{(pid=75102) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-af5e93b7-2253-4b2d-97f3-c18fc33e38eb req-fac945f5-d751-4e05-962d-669f00883400 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-af5e93b7-2253-4b2d-97f3-c18fc33e38eb req-fac945f5-d751-4e05-962d-669f00883400 service nova] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-af5e93b7-2253-4b2d-97f3-c18fc33e38eb req-fac945f5-d751-4e05-962d-669f00883400 service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-af5e93b7-2253-4b2d-97f3-c18fc33e38eb req-fac945f5-d751-4e05-962d-669f00883400 service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-af5e93b7-2253-4b2d-97f3-c18fc33e38eb req-fac945f5-d751-4e05-962d-669f00883400 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] No waiting events found dispatching network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:26 user nova-compute[75102]: WARNING nova.compute.manager [req-af5e93b7-2253-4b2d-97f3-c18fc33e38eb req-fac945f5-d751-4e05-962d-669f00883400 service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received unexpected event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb for instance with vm_state active and task_state resize_migrated.
Nov 10 16:39:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquired lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG nova.network.neutron [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG nova.network.neutron [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating instance_info_cache with network_info: [{"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:39:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Releasing lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG os_brick.utils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[084ad4e2-d079-4920-a4df-97287497b278]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a3d263-8d83-4a12-a21d-5b6eb320b33b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[57aafda4-e270-460e-b203-6c53bdef8167]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c8e2fec-5eca-47f9-929d-e8cdeba127ea]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:39:27 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:39:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c96f81c-e6c6-4262-aa42-3ff54ed58195]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:39:27 user nova-compute[75102]: DEBUG os_brick.utils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:39:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.volume.cinder [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Update attachment failed for attachment 3fc79b83-9993-4776-a2d1-5e083028bf7d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7185ad75-6295-4584-a22f-d1f2b0612282) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7185ad75-6295-4584-a22f-d1f2b0612282)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Failed to attach 7d6afae8-61c4-4d1a-ae1a-6c6886393dcf at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7185ad75-6295-4584-a22f-d1f2b0612282)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Traceback (most recent call last):
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     self._volume_attach(context, volume, connector, instance,
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     connection_info = volume_api.attachment_update(
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     res = method(self, ctx, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     with excutils.save_and_reraise_exception():
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     self.force_reraise()
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     raise self.value
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     return method.func(obj, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     return self.request(url, method, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9]     raise exceptions.from_response(resp, body)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7185ad75-6295-4584-a22f-d1f2b0612282)
Nov 10 16:39:32 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] 
Nov 10 16:39:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 18.469s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server [None req-0bed7f58-4965-4172-80a5-ec15a9f1b614 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7185ad75-6295-4584-a22f-d1f2b0612282)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-7185ad75-6295-4584-a22f-d1f2b0612282)
Nov 10 16:39:32 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:33 user nova-compute[75102]: INFO nova.compute.manager [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Terminating instance
Nov 10 16:39:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:33 user nova-compute[75102]: INFO nova.compute.manager [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Detaching volume 8575017f-6d0b-4a41-8883-acedde608735
Nov 10 16:39:33 user nova-compute[75102]: INFO nova.virt.block_device [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Attempting to driver detach volume 8575017f-6d0b-4a41-8883-acedde608735 from mountpoint /dev/vdb
Nov 10 16:39:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-9b749508-e31c-42ee-923a-3c38c086024d req-c28afafd-230d-4b31-87c4-9c306e0eacf2 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-unplugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9b749508-e31c-42ee-923a-3c38c086024d req-c28afafd-230d-4b31-87c4-9c306e0eacf2 service nova] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9b749508-e31c-42ee-923a-3c38c086024d req-c28afafd-230d-4b31-87c4-9c306e0eacf2 service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9b749508-e31c-42ee-923a-3c38c086024d req-c28afafd-230d-4b31-87c4-9c306e0eacf2 service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-9b749508-e31c-42ee-923a-3c38c086024d req-c28afafd-230d-4b31-87c4-9c306e0eacf2 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] No waiting events found dispatching network-vif-unplugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-9b749508-e31c-42ee-923a-3c38c086024d req-c28afafd-230d-4b31-87c4-9c306e0eacf2 service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-unplugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Attempting to detach device vdb from instance 4011f0df-65d5-43a9-bc81-876e451a9095 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:39:33 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:39:33 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:39:33 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:39:33 user nova-compute[75102]:   <serial>8575017f-6d0b-4a41-8883-acedde608735</serial>
Nov 10 16:39:33 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:39:33 user nova-compute[75102]: </disk>
Nov 10 16:39:33 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:39:33 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Successfully detached device vdb from instance 4011f0df-65d5-43a9-bc81-876e451a9095 from the persistent domain config.
Nov 10 16:39:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4011f0df-65d5-43a9-bc81-876e451a9095 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:39:33 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:39:33 user nova-compute[75102]:   <source dev="/dev/sdc"/>
Nov 10 16:39:33 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:39:33 user nova-compute[75102]:   <serial>8575017f-6d0b-4a41-8883-acedde608735</serial>
Nov 10 16:39:33 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:39:33 user nova-compute[75102]: </disk>
Nov 10 16:39:33 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4011f0df-65d5-43a9-bc81-876e451a9095 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:39:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Instance destroyed successfully.
Nov 10 16:39:34 user nova-compute[75102]: DEBUG nova.objects.instance [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'resources' on Instance uuid 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1486306092',display_name='tempest-TestVolumeBootPattern-server-1486306092',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1486306092',id=38,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:38:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-h6aswgr1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:38:20Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=3cbb3485-343d-46e0-a9e2-5bbcb5f4971e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "address": "fa:16:3e:d9:62:90", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79bd2c0c-6a", "ovs_interfaceid": "79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:62:90,bridge_name='br-int',has_traffic_filtering=True,id=79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79bd2c0c-6a') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_vif [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:62:90,bridge_name='br-int',has_traffic_filtering=True,id=79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79bd2c0c-6a') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79bd2c0c-6a, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f3cdc753-232b-4357-a1d8-8b2744bbf4d1) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: INFO os_vif [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:62:90,bridge_name='br-int',has_traffic_filtering=True,id=79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79bd2c0c-6a')
Nov 10 16:39:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FOqSKyIb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:39:34 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[648d42ba-dc77-43c5-85d4-4a47c0dfbbda]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:39:34 user nova-compute[75102]: No targets found.
Nov 10 16:39:34 user nova-compute[75102]: iSNS:
Nov 10 16:39:34 user nova-compute[75102]: No targets found.
Nov 10 16:39:34 user nova-compute[75102]: STATIC:
Nov 10 16:39:34 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735
Nov 10 16:39:34 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:39:34 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:39:34 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7
Nov 10 16:39:34 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:39:34 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:39:34 user nova-compute[75102]: FIRMWARE:
Nov 10 16:39:34 user nova-compute[75102]: No targets found.
Nov 10 16:39:34 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:39:34 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:39:34 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f8b69de-4be6-448d-bdb9-20239f2e0562]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c78f024-8993-42ac-8757-b8f684863a2e]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:34 user nova-compute[75102]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 (non-flash)
Nov 10 16:39:34 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:34 user nova-compute[75102]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 (non-flash)
Nov 10 16:39:34 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f544bad40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a27b9017-ce74-4aa9-9622-d679469018f3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf2e43-7298-4b13-9ac0-b284207feff6]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1661b244-2868-43e9-aa2d-fea49991c72a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.041s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef0f64b-9264-488d-b51c-2d4ff166f1b8]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6540acd-1bec-4c2b-abdd-6767cfe2ad48]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ef8d45-5903-4fe4-9cec-39bfc68c6b6b]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7, portal: 172.16.0.220,3260]
Nov 10 16:39:34 user nova-compute[75102]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7, portal: 172.16.0.220,3260] successful.
Nov 10 16:39:34 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f406dff4-5b39-4686-b89f-39954802fea7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef8923b-dab5-4df0-b9aa-b6e9c66d1639]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== disconnect_volume: return (319ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:39:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Deleting instance files /opt/stack/data/nova/instances/3cbb3485-343d-46e0-a9e2-5bbcb5f4971e_del
Nov 10 16:39:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Deletion of /opt/stack/data/nova/instances/3cbb3485-343d-46e0-a9e2-5bbcb5f4971e_del complete
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: INFO nova.compute.manager [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Took 1.51 seconds to destroy the instance on the hypervisor.
Nov 10 16:39:34 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:39:35 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Took 0.50 seconds to deallocate network for instance.
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-178651aa-2a1e-4916-b327-220478c15bc6 req-105c565d-44aa-4a1f-8a8e-0285a039d02f service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-deleted-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] No waiting events found dispatching network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:35 user nova-compute[75102]: WARNING nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received unexpected event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf for instance with vm_state active and task_state deleting.
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] No waiting events found dispatching network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:35 user nova-compute[75102]: WARNING nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received unexpected event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf for instance with vm_state active and task_state deleting.
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] No waiting events found dispatching network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:35 user nova-compute[75102]: WARNING nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received unexpected event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf for instance with vm_state active and task_state deleting.
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-unplugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] No waiting events found dispatching network-vif-unplugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-unplugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Acquiring lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] No waiting events found dispatching network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:35 user nova-compute[75102]: WARNING nova.compute.manager [req-718608d6-da21-4f74-9661-f72109ab709d req-6dca00ee-39fa-46e9-b55a-386229b7db5d service nova] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Received unexpected event network-vif-plugged-79bd2c0c-6a6f-4b7b-90ee-b5ad3f520eaf for instance with vm_state active and task_state deleting.
Nov 10 16:39:35 user nova-compute[75102]: INFO nova.compute.manager [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Took 0.94 seconds to detach 1 volumes for instance.
Nov 10 16:39:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e] Deleting volume: f406dff4-5b39-4686-b89f-39954802fea7 {{(pid=75102) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 16:39:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:36 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:39:36 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:39:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.340s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:36 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Deleted allocations for instance 3cbb3485-343d-46e0-a9e2-5bbcb5f4971e
Nov 10 16:39:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-df9ae80f-5c4b-447c-b23e-bf22a63c57dc tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "3cbb3485-343d-46e0-a9e2-5bbcb5f4971e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.551s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:39:44 user nova-compute[75102]: INFO nova.compute.claims [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Claim successful on node user
Nov 10 16:39:44 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:39:44 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:39:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:39:45 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG nova.policy [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '190f5287874a4a04a1436f7c6b5213d7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b7089a983faf4dbebfc6f9514a154c83', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:39:45 user nova-compute[75102]: INFO nova.virt.block_device [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Booting with volume 3c728d84-7f73-45ab-9cd6-475ca4b19334 at /dev/vda
Nov 10 16:39:45 user nova-compute[75102]: DEBUG os_brick.utils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d199fc0-6a98-49e2-8746-7b83b06d3d45]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[896944d4-13d3-4ad5-bc4b-3031b5e9a0ae]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[936e14f3-7e1b-43d0-b4ad-b1e77980e085]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8d79f9-10c7-4296-8054-27de34a63ec7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:39:45 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:39:45 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff71142a-f619-4dcd-974d-5181bd698d68]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG os_brick.utils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating existing volume attachment record: 8d6699ed-ad36-47ba-bf11-ce2c602c1ed4 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:45 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Successfully created port: 41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Successfully updated port: 41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquired lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG nova.compute.manager [req-30fd8cd5-57ca-4a09-8bf5-6c422a9b97f3 req-b5974bc5-ceea-461e-b1df-d4d3c062963c service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG nova.compute.manager [req-30fd8cd5-57ca-4a09-8bf5-6c422a9b97f3 req-b5974bc5-ceea-461e-b1df-d4d3c062963c service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing instance network info cache due to event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-30fd8cd5-57ca-4a09-8bf5-6c422a9b97f3 req-b5974bc5-ceea-461e-b1df-d4d3c062963c service nova] Acquiring lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Releasing lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Instance network_info: |[{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-30fd8cd5-57ca-4a09-8bf5-6c422a9b97f3 req-b5974bc5-ceea-461e-b1df-d4d3c062963c service nova] Acquired lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:39:46 user nova-compute[75102]: DEBUG nova.network.neutron [req-30fd8cd5-57ca-4a09-8bf5-6c422a9b97f3 req-b5974bc5-ceea-461e-b1df-d4d3c062963c service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:39:47 user nova-compute[75102]: DEBUG nova.network.neutron [req-30fd8cd5-57ca-4a09-8bf5-6c422a9b97f3 req-b5974bc5-ceea-461e-b1df-d4d3c062963c service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updated VIF entry in instance network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:39:47 user nova-compute[75102]: DEBUG nova.network.neutron [req-30fd8cd5-57ca-4a09-8bf5-6c422a9b97f3 req-b5974bc5-ceea-461e-b1df-d4d3c062963c service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:39:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-30fd8cd5-57ca-4a09-8bf5-6c422a9b97f3 req-b5974bc5-ceea-461e-b1df-d4d3c062963c service nova] Releasing lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:39:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Starting finish_migration {{(pid=75102) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Instance directory exists: not creating {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 16:39:51 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Creating image(s)
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Ensure instance console log exists: /opt/stack/data/nova/instances/da5d6c88-342c-423d-b0f4-5a18774e91f4/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Start _get_guest_xml network_info=[{"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-197547384-network", "vif_mac": "fa:16:3e:73:47:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8b1b76f8-247d-4c54-91a8-ffa96809e7ad', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYAhnOwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'da5d6c88-342c-423d-b0f4-5a18774e91f4', 'attached_at': '2023-11-10T16:39:51.000000', 'detached_at': '', 'volume_id': 'ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'serial': 'ad91eebd-e6b0-4f8f-a4ef-5055932f8a24'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:39:51 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:39:51 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:12:00Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYAhnOwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:39:51 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:39:51 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:39:51 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3a329a-9c52-4477-8bdf-e4800bd2744a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:39:51 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[91fce0fd-b4ef-49f1-9e64-90f204acbe75]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24] added
Nov 10 16:39:51 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a063b205-998a-4448-97ed-775c6fa2c240]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[221a7ef1-e5ab-4042-9ec6-b3293cfb9a06]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sYAhnOwR {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v sYAhnOwR" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[57777202-2203-4b07-9dac-d44670fe156c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'sYAhnOwR'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea33324a-09d8-4e02-a8b1-a0fe6032d40c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4754f07b-d831-45c6-9093-b5f0783585f7]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:51 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:51 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[638f2429-f73d-4470-b959-844b5dfb15ac]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260]
Nov 10 16:39:51 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260] successful.
Nov 10 16:39:51 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9f03818-aa10-40bf-adbe-2b34c04086dd]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1151ce-a2ec-4d37-ae38-ea3be0f77a1f]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:51 user nova-compute[75102]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:39:51 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:51 user nova-compute[75102]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:39:51 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.273s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[66d87c31-abd5-438d-a83a-34e6ba2735d3]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:39:51 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYAhnOwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23038343533666662', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23038343533666662', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1390976736',display_name='tempest-ServerActionsTestOtherA-server-1390976736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1390976736',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJIyuW1YgII5m42ZzPQI/sKQHH3q65mUxP8WzQFSf/4n/JTQ1Wu3opROEkHOGysy1Wt2WY0dRoS8kKXFZZja/7C79VSuXQ0L9aJFgTEonW/PDJXKdDwWpg0JM1ZatQvbg==',key_name='tempest-keypair-394571970',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:38:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-s4xfkfdf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=da5d6c88-342c-423d-b0f4-5a18774e91f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-197547384-network", "vif_mac": "fa:16:3e:73:47:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-197547384-network", "vif_mac": "fa:16:3e:73:47:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:39:52 user nova-compute[75102]:   <uuid>da5d6c88-342c-423d-b0f4-5a18774e91f4</uuid>
Nov 10 16:39:52 user nova-compute[75102]:   <name>instance-00000025</name>
Nov 10 16:39:52 user nova-compute[75102]:   <memory>2097152</memory>
Nov 10 16:39:52 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:39:52 user nova-compute[75102]:   <metadata>
Nov 10 16:39:52 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:39:52 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:39:52 user nova-compute[75102]:       <nova:name>tempest-ServerActionsTestOtherA-server-1390976736</nova:name>
Nov 10 16:39:52 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:39:51</nova:creationTime>
Nov 10 16:39:52 user nova-compute[75102]:       <nova:flavor name="m1.small">
Nov 10 16:39:52 user nova-compute[75102]:         <nova:memory>2048</nova:memory>
Nov 10 16:39:52 user nova-compute[75102]:         <nova:disk>20</nova:disk>
Nov 10 16:39:52 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:39:52 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:39:52 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:39:52 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:39:52 user nova-compute[75102]:       <nova:owner>
Nov 10 16:39:52 user nova-compute[75102]:         <nova:user uuid="7bbea9eecf0b4e998ad458bc0d30a5bf">tempest-ServerActionsTestOtherA-1931720116-project-member</nova:user>
Nov 10 16:39:52 user nova-compute[75102]:         <nova:project uuid="46f5704b433744dd8188e61d576dd461">tempest-ServerActionsTestOtherA-1931720116</nova:project>
Nov 10 16:39:52 user nova-compute[75102]:       </nova:owner>
Nov 10 16:39:52 user nova-compute[75102]:       <nova:ports>
Nov 10 16:39:52 user nova-compute[75102]:         <nova:port uuid="7530f992-ba56-418f-abbe-0e16fe005dfb">
Nov 10 16:39:52 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:39:52 user nova-compute[75102]:         </nova:port>
Nov 10 16:39:52 user nova-compute[75102]:       </nova:ports>
Nov 10 16:39:52 user nova-compute[75102]:     </nova:instance>
Nov 10 16:39:52 user nova-compute[75102]:   </metadata>
Nov 10 16:39:52 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:39:52 user nova-compute[75102]:     <system>
Nov 10 16:39:52 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:39:52 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:39:52 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:39:52 user nova-compute[75102]:       <entry name="serial">da5d6c88-342c-423d-b0f4-5a18774e91f4</entry>
Nov 10 16:39:52 user nova-compute[75102]:       <entry name="uuid">da5d6c88-342c-423d-b0f4-5a18774e91f4</entry>
Nov 10 16:39:52 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:39:52 user nova-compute[75102]:     </system>
Nov 10 16:39:52 user nova-compute[75102]:   </sysinfo>
Nov 10 16:39:52 user nova-compute[75102]:   <os>
Nov 10 16:39:52 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:39:52 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:39:52 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:39:52 user nova-compute[75102]:   </os>
Nov 10 16:39:52 user nova-compute[75102]:   <features>
Nov 10 16:39:52 user nova-compute[75102]:     <acpi/>
Nov 10 16:39:52 user nova-compute[75102]:     <apic/>
Nov 10 16:39:52 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:39:52 user nova-compute[75102]:   </features>
Nov 10 16:39:52 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:39:52 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:39:52 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:39:52 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:39:52 user nova-compute[75102]:   </clock>
Nov 10 16:39:52 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:39:52 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:39:52 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:39:52 user nova-compute[75102]:   </cpu>
Nov 10 16:39:52 user nova-compute[75102]:   <devices>
Nov 10 16:39:52 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:39:52 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:39:52 user nova-compute[75102]:       <source dev="/dev/sdb"/>
Nov 10 16:39:52 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:39:52 user nova-compute[75102]:       <serial>ad91eebd-e6b0-4f8f-a4ef-5055932f8a24</serial>
Nov 10 16:39:52 user nova-compute[75102]:     </disk>
Nov 10 16:39:52 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:39:52 user nova-compute[75102]:       <mac address="fa:16:3e:73:47:f7"/>
Nov 10 16:39:52 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:39:52 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:39:52 user nova-compute[75102]:       <target dev="tap7530f992-ba"/>
Nov 10 16:39:52 user nova-compute[75102]:     </interface>
Nov 10 16:39:52 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:39:52 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/da5d6c88-342c-423d-b0f4-5a18774e91f4/console.log" append="off"/>
Nov 10 16:39:52 user nova-compute[75102]:     </serial>
Nov 10 16:39:52 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:39:52 user nova-compute[75102]:     <video>
Nov 10 16:39:52 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:39:52 user nova-compute[75102]:     </video>
Nov 10 16:39:52 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:39:52 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:39:52 user nova-compute[75102]:     </rng>
Nov 10 16:39:52 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:39:52 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:39:52 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:39:52 user nova-compute[75102]:     </memballoon>
Nov 10 16:39:52 user nova-compute[75102]:   </devices>
Nov 10 16:39:52 user nova-compute[75102]: </domain>
Nov 10 16:39:52 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1390976736',display_name='tempest-ServerActionsTestOtherA-server-1390976736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1390976736',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJIyuW1YgII5m42ZzPQI/sKQHH3q65mUxP8WzQFSf/4n/JTQ1Wu3opROEkHOGysy1Wt2WY0dRoS8kKXFZZja/7C79VSuXQ0L9aJFgTEonW/PDJXKdDwWpg0JM1ZatQvbg==',key_name='tempest-keypair-394571970',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:38:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-s4xfkfdf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:39:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=da5d6c88-342c-423d-b0f4-5a18774e91f4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-197547384-network", "vif_mac": "fa:16:3e:73:47:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-197547384-network", "vif_mac": "fa:16:3e:73:47:f7"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG os_vif [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:39:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a9b78867-3f7e-53e6-ad67-3bf1e5994f24', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7530f992-ba, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7530f992-ba, col_values=(('qos', UUID('0c55a12b-0c35-4258-b018-9ec413cd6af9')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7530f992-ba, col_values=(('external_ids', {'iface-id': '7530f992-ba56-418f-abbe-0e16fe005dfb', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:47:f7', 'vm-uuid': 'da5d6c88-342c-423d-b0f4-5a18774e91f4'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:53 user nova-compute[75102]: INFO os_vif [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba')
Nov 10 16:39:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:39:53 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] No VIF found with MAC fa:16:3e:73:47:f7, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:39:54 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4011f0df-65d5-43a9-bc81-876e451a9095 is timed out.
Nov 10 16:39:54 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Successfully detached device vdb from instance 4011f0df-65d5-43a9-bc81-876e451a9095 from the live domain config.
Nov 10 16:39:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJAfHUNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:39:54 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4183d0f5-b0f7-46c5-8d3b-e44c2210f671]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:39:54 user nova-compute[75102]: No targets found.
Nov 10 16:39:54 user nova-compute[75102]: iSNS:
Nov 10 16:39:54 user nova-compute[75102]: No targets found.
Nov 10 16:39:54 user nova-compute[75102]: STATIC:
Nov 10 16:39:54 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735
Nov 10 16:39:54 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:39:54 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:39:54 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24
Nov 10 16:39:54 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:39:54 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:39:54 user nova-compute[75102]: FIRMWARE:
Nov 10 16:39:54 user nova-compute[75102]: No targets found.
Nov 10 16:39:54 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:39:54 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:39:54 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9c0d3b1-bf80-452a-8109-25cc2873034d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f124eece-ac77-4e02-b6c4-8b3c55e0f6df]: (4, ('tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:54 user nova-compute[75102]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:39:54 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsi session list stdout=tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 (non-flash)
Nov 10 16:39:54 user nova-compute[75102]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:39:54 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f8e624af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c006bd-31c0-4eea-b424-eaafa75045d2]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf40558-8c5f-4b21-8580-159e91041894]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c16f5dd-5d8e-444d-9b09-feea988c21be]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.035s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d45a634b-c9ee-44b0-b024-518f14ad256a]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e3f21d2-d512-4555-954c-09a876905bd9]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[52823b4a-807b-4713-b545-27fa729faf10]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735, portal: 172.16.0.220,3260]
Nov 10 16:39:54 user nova-compute[75102]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735, portal: 172.16.0.220,3260] successful.
Nov 10 16:39:54 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f249b24b-811c-430c-bb05-e745fb124f66]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] <== disconnect_volume: return (315ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-244bad42-1ab1-4307-a131-6f3a6a1473d8 req-56d7dbb7-1d89-4bd6-9a3f-f8d7c3aef1ba service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-244bad42-1ab1-4307-a131-6f3a6a1473d8 req-56d7dbb7-1d89-4bd6-9a3f-f8d7c3aef1ba service nova] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-244bad42-1ab1-4307-a131-6f3a6a1473d8 req-56d7dbb7-1d89-4bd6-9a3f-f8d7c3aef1ba service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-244bad42-1ab1-4307-a131-6f3a6a1473d8 req-56d7dbb7-1d89-4bd6-9a3f-f8d7c3aef1ba service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-244bad42-1ab1-4307-a131-6f3a6a1473d8 req-56d7dbb7-1d89-4bd6-9a3f-f8d7c3aef1ba service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] No waiting events found dispatching network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:54 user nova-compute[75102]: WARNING nova.compute.manager [req-244bad42-1ab1-4307-a131-6f3a6a1473d8 req-56d7dbb7-1d89-4bd6-9a3f-f8d7c3aef1ba service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received unexpected event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb for instance with vm_state active and task_state resize_finish.
Nov 10 16:39:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:39:56 user nova-compute[75102]: DEBUG nova.compute.manager [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:39:56 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Instance running successfully.
Nov 10 16:39:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Failed to set time: agent not configured {{(pid=75102) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 10 16:39:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-88bd17f8-d9a3-4768-a52a-55cd4684cd38 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] finish_migration finished successfully. {{(pid=75102) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 10 16:39:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-e79812b8-5004-48ad-b9cc-cb9f16d4edc2 req-974fc8d6-cb67-4be5-94ab-7178c6d4a11e service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:39:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e79812b8-5004-48ad-b9cc-cb9f16d4edc2 req-974fc8d6-cb67-4be5-94ab-7178c6d4a11e service nova] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:39:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e79812b8-5004-48ad-b9cc-cb9f16d4edc2 req-974fc8d6-cb67-4be5-94ab-7178c6d4a11e service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:39:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e79812b8-5004-48ad-b9cc-cb9f16d4edc2 req-974fc8d6-cb67-4be5-94ab-7178c6d4a11e service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:39:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-e79812b8-5004-48ad-b9cc-cb9f16d4edc2 req-974fc8d6-cb67-4be5-94ab-7178c6d4a11e service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] No waiting events found dispatching network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:39:56 user nova-compute[75102]: WARNING nova.compute.manager [req-e79812b8-5004-48ad-b9cc-cb9f16d4edc2 req-974fc8d6-cb67-4be5-94ab-7178c6d4a11e service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received unexpected event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb for instance with vm_state resized and task_state None.
Nov 10 16:39:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:40:05 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:05 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:06 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:06 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:06 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:40:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.244s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-5fa9a658-0683-402a-aa98-de074abcf3ee req-232e71b0-5260-4f77-a01a-be88eb89ad1b service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received event network-changed-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-5fa9a658-0683-402a-aa98-de074abcf3ee req-232e71b0-5260-4f77-a01a-be88eb89ad1b service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Refreshing instance network info cache due to event network-changed-b53fde8e-547c-4e1c-af0a-d3f4108b146f. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5fa9a658-0683-402a-aa98-de074abcf3ee req-232e71b0-5260-4f77-a01a-be88eb89ad1b service nova] Acquiring lock "refresh_cache-0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5fa9a658-0683-402a-aa98-de074abcf3ee req-232e71b0-5260-4f77-a01a-be88eb89ad1b service nova] Acquired lock "refresh_cache-0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-5fa9a658-0683-402a-aa98-de074abcf3ee req-232e71b0-5260-4f77-a01a-be88eb89ad1b service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Refreshing network info cache for port b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.316s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-5fa9a658-0683-402a-aa98-de074abcf3ee req-232e71b0-5260-4f77-a01a-be88eb89ad1b service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Updated VIF entry in instance network info cache for port b53fde8e-547c-4e1c-af0a-d3f4108b146f. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-5fa9a658-0683-402a-aa98-de074abcf3ee req-232e71b0-5260-4f77-a01a-be88eb89ad1b service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Updating instance_info_cache with network_info: [{"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5fa9a658-0683-402a-aa98-de074abcf3ee req-232e71b0-5260-4f77-a01a-be88eb89ad1b service nova] Releasing lock "refresh_cache-0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:40:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:40:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7901MB free_disk=25.01382827758789GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Applying migration context for instance da5d6c88-342c-423d-b0f4-5a18774e91f4 as it has an incoming, in-progress migration e8fa2133-07a8-4ddc-8979-fc2d3db675e7. Migration status is finished {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 16:40:09 user nova-compute[75102]: INFO nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating resource usage from migration e8fa2133-07a8-4ddc-8979-fc2d3db675e7
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4011f0df-65d5-43a9-bc81-876e451a9095 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Migration e8fa2133-07a8-4ddc-8979-fc2d3db675e7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance da5d6c88-342c-423d-b0f4-5a18774e91f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b57fe73f-7ce0-4290-9f14-300de96d9e38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:40:09 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:40:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:10 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:40:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:40:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:40:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.785s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:11 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:11 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:11 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:40:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 16:40:11 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:40:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'flavor' on Instance uuid 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:14 user nova-compute[75102]: INFO nova.compute.manager [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Attaching volume 4bb0d356-a9ec-496d-8977-ab4ed84b8e3b to /dev/vdb
Nov 10 16:40:14 user nova-compute[75102]: DEBUG os_brick.utils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[57822d94-df44-4473-b03e-cc7e1b425b94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[060ebb3a-5597-489e-bde2-fec3b51a7fa1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b8ea42-53e1-468c-a011-8ba2dc7bae66]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed42923d-dd7c-4646-82a1-71940da70bff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:40:14 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:40:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f10814c9-38c4-4b3e-8dd0-604b2bb9f273]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG os_brick.utils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:40:14 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Updating existing volume attachment record: 1e58d987-cc80-4222-af97-03a1e7da55a0 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:40:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG nova.objects.instance [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'flavor' on Instance uuid 4011f0df-65d5-43a9-bc81-876e451a9095 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4e5a6921-5ca6-4120-80f5-ccdb6496b579 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 47.644s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 47.414s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:20 user nova-compute[75102]: INFO nova.compute.manager [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Terminating instance
Nov 10 16:40:20 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-7680fdfb-4a49-434c-ad3d-93c41f23423e req-3e7835c1-e7ea-40b6-8845-88a853e1ed31 service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received event network-vif-unplugged-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7680fdfb-4a49-434c-ad3d-93c41f23423e req-3e7835c1-e7ea-40b6-8845-88a853e1ed31 service nova] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7680fdfb-4a49-434c-ad3d-93c41f23423e req-3e7835c1-e7ea-40b6-8845-88a853e1ed31 service nova] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7680fdfb-4a49-434c-ad3d-93c41f23423e req-3e7835c1-e7ea-40b6-8845-88a853e1ed31 service nova] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.006s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-7680fdfb-4a49-434c-ad3d-93c41f23423e req-3e7835c1-e7ea-40b6-8845-88a853e1ed31 service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] No waiting events found dispatching network-vif-unplugged-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-7680fdfb-4a49-434c-ad3d-93c41f23423e req-3e7835c1-e7ea-40b6-8845-88a853e1ed31 service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received event network-vif-unplugged-b467529d-8282-454a-bfe1-c9d6e4f9780a for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:40:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Creating image(s)
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Ensure instance console log exists: /opt/stack/data/nova/instances/b57fe73f-7ce0-4290-9f14-300de96d9e38/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Start _get_guest_xml network_info=[{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '8d6699ed-ad36-47ba-bf11-ce2c602c1ed4', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmLjEcxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b57fe73f-7ce0-4290-9f14-300de96d9e38', 'attached_at': '', 'detached_at': '', 'volume_id': '3c728d84-7f73-45ab-9cd6-475ca4b19334', 'serial': '3c728d84-7f73-45ab-9cd6-475ca4b19334'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:40:21 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:40:21 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmLjEcxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:40:21 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:40:21 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:40:21 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f73582b-e066-45fb-99bf-f72c2b8a48ea]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:40:21 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[88a9f661-b578-4632-aec1-8e164e90eef5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334] added
Nov 10 16:40:21 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[10095207-10cf-4bef-81d3-34e27db2760f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a711c223-1fdb-4b2d-9b4f-cec0c3a7e858]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmLjEcxl {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmLjEcxl" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[db119bb5-4fa8-4560-960c-b60136db221f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PmLjEcxl'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Instance destroyed successfully.
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.objects.instance [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'resources' on Instance uuid 4011f0df-65d5-43a9-bc81-876e451a9095 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[752a87d2-3eb9-467f-a39b-e2c06afd76b0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:35:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-679472681',display_name='tempest-VolumesSnapshotTestJSON-instance-679472681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-679472681',id=35,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOYhAhKgSUV5NfoOw/dNsWeWgys7bRTKP2syQtAVu185olwJ9OHiIljveAa9UtDk6kybwjQL52KcnpZA/dBTzznnuSG8Gu0Fzwmu+UGpnI+y/Nh2popsgRiwMNrkct5UBA==',key_name='tempest-keypair-1349778118',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:36:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b9ad4975bb43fdbb94dd2742b3d590',ramdisk_id='',reservation_id='r-77btjyai',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-803710656',owner_user_name='tempest-VolumesSnapshotTestJSON-803710656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:36:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78829a85087437da8edf53a02ae7358',uuid=4011f0df-65d5-43a9-bc81-876e451a9095,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converting VIF {"id": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "address": "fa:16:3e:08:4b:7d", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.176", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb467529d-82", "ovs_interfaceid": "b467529d-8282-454a-bfe1-c9d6e4f9780a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=b467529d-8282-454a-bfe1-c9d6e4f9780a,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb467529d-82') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_vif [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=b467529d-8282-454a-bfe1-c9d6e4f9780a,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb467529d-82') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb467529d-82, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[96da179d-eebb-4c1d-9f6a-fd6cf2438242]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:21 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:21 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db755c9b-f28a-4308-b799-b36a6f360134) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:40:21 user nova-compute[75102]: INFO os_vif [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:4b:7d,bridge_name='br-int',has_traffic_filtering=True,id=b467529d-8282-454a-bfe1-c9d6e4f9780a,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb467529d-82')
Nov 10 16:40:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GJAfHUNY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:40:21 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0709d2-ec68-44de-9e31-97cbe0ab84a3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260]
Nov 10 16:40:21 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260] successful.
Nov 10 16:40:21 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcfbfaf-8d67-432c-8070-f4828128fd78]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0f5097-bfbd-4bdf-9563-f6a5e79bacf6]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:21 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:40:21 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:21 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:40:21 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] HCTL ('34', '-', '-', 0) found on session 35 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[47abf9ea-41b5-40c6-9cf7-85c229ec07df]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Searching for a device in session 35 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:40:21 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmLjEcxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '26661383731323464', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383731323464', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.119s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e864e301-9441-4f61-9e69-5ecd24a2230d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:40:22 user nova-compute[75102]: No targets found.
Nov 10 16:40:22 user nova-compute[75102]: iSNS:
Nov 10 16:40:22 user nova-compute[75102]: No targets found.
Nov 10 16:40:22 user nova-compute[75102]: STATIC:
Nov 10 16:40:22 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334
Nov 10 16:40:22 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:40:22 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:40:22 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24
Nov 10 16:40:22 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:40:22 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:40:22 user nova-compute[75102]: FIRMWARE:
Nov 10 16:40:22 user nova-compute[75102]: No targets found.
Nov 10 16:40:22 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:40:22 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:40:22 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8575017f-6d0b-4a41-8883-acedde608735', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:40:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1971436327',display_name='tempest-TestShelveInstance-server-1971436327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1971436327',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEmWswTifVR81PjbzdI9ymWWUXNhpQ0j1viup1f7qEgXcRBOnJrEhKddKHYWk8zUUQMJCwde0yp39CzlCdLrw7tXOZollMQO4SchG7cVgghMd/x4lwDXcRBqtv/uZ4hsQ==',key_name='tempest-TestShelveInstance-1509801576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7089a983faf4dbebfc6f9514a154c83',ramdisk_id='',reservation_id='r-he2uv6iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-188193481',owner_user_name='tempest-TestShelveInstance-188193481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:39:45Z,user_data=None,user_id='190f5287874a4a04a1436f7c6b5213d7',uuid=b57fe73f-7ce0-4290-9f14-300de96d9e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converting VIF {"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lazy-loading 'pci_devices' on Instance uuid b57fe73f-7ce0-4290-9f14-300de96d9e38 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:40:23 user nova-compute[75102]:   <uuid>b57fe73f-7ce0-4290-9f14-300de96d9e38</uuid>
Nov 10 16:40:23 user nova-compute[75102]:   <name>instance-00000028</name>
Nov 10 16:40:23 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:40:23 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:40:23 user nova-compute[75102]:   <metadata>
Nov 10 16:40:23 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:40:23 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:40:23 user nova-compute[75102]:       <nova:name>tempest-TestShelveInstance-server-1971436327</nova:name>
Nov 10 16:40:23 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:40:21</nova:creationTime>
Nov 10 16:40:23 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:40:23 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:40:23 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:40:23 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:40:23 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:40:23 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:40:23 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:40:23 user nova-compute[75102]:       <nova:owner>
Nov 10 16:40:23 user nova-compute[75102]:         <nova:user uuid="190f5287874a4a04a1436f7c6b5213d7">tempest-TestShelveInstance-188193481-project-member</nova:user>
Nov 10 16:40:23 user nova-compute[75102]:         <nova:project uuid="b7089a983faf4dbebfc6f9514a154c83">tempest-TestShelveInstance-188193481</nova:project>
Nov 10 16:40:23 user nova-compute[75102]:       </nova:owner>
Nov 10 16:40:23 user nova-compute[75102]:       <nova:ports>
Nov 10 16:40:23 user nova-compute[75102]:         <nova:port uuid="41c704f1-d29a-491b-9f9f-d1d4e3badf13">
Nov 10 16:40:23 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 16:40:23 user nova-compute[75102]:         </nova:port>
Nov 10 16:40:23 user nova-compute[75102]:       </nova:ports>
Nov 10 16:40:23 user nova-compute[75102]:     </nova:instance>
Nov 10 16:40:23 user nova-compute[75102]:   </metadata>
Nov 10 16:40:23 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:40:23 user nova-compute[75102]:     <system>
Nov 10 16:40:23 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:40:23 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:40:23 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:40:23 user nova-compute[75102]:       <entry name="serial">b57fe73f-7ce0-4290-9f14-300de96d9e38</entry>
Nov 10 16:40:23 user nova-compute[75102]:       <entry name="uuid">b57fe73f-7ce0-4290-9f14-300de96d9e38</entry>
Nov 10 16:40:23 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:40:23 user nova-compute[75102]:     </system>
Nov 10 16:40:23 user nova-compute[75102]:   </sysinfo>
Nov 10 16:40:23 user nova-compute[75102]:   <os>
Nov 10 16:40:23 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:40:23 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:40:23 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:40:23 user nova-compute[75102]:   </os>
Nov 10 16:40:23 user nova-compute[75102]:   <features>
Nov 10 16:40:23 user nova-compute[75102]:     <acpi/>
Nov 10 16:40:23 user nova-compute[75102]:     <apic/>
Nov 10 16:40:23 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:40:23 user nova-compute[75102]:   </features>
Nov 10 16:40:23 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:40:23 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:40:23 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:40:23 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:40:23 user nova-compute[75102]:   </clock>
Nov 10 16:40:23 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:40:23 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:40:23 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:40:23 user nova-compute[75102]:   </cpu>
Nov 10 16:40:23 user nova-compute[75102]:   <devices>
Nov 10 16:40:23 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:40:23 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:40:23 user nova-compute[75102]:       <source dev="/dev/sdc"/>
Nov 10 16:40:23 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:40:23 user nova-compute[75102]:       <serial>3c728d84-7f73-45ab-9cd6-475ca4b19334</serial>
Nov 10 16:40:23 user nova-compute[75102]:     </disk>
Nov 10 16:40:23 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:40:23 user nova-compute[75102]:       <mac address="fa:16:3e:67:34:f2"/>
Nov 10 16:40:23 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:40:23 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:40:23 user nova-compute[75102]:       <target dev="tap41c704f1-d2"/>
Nov 10 16:40:23 user nova-compute[75102]:     </interface>
Nov 10 16:40:23 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:40:23 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/b57fe73f-7ce0-4290-9f14-300de96d9e38/console.log" append="off"/>
Nov 10 16:40:23 user nova-compute[75102]:     </serial>
Nov 10 16:40:23 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:40:23 user nova-compute[75102]:     <video>
Nov 10 16:40:23 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:40:23 user nova-compute[75102]:     </video>
Nov 10 16:40:23 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:40:23 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:40:23 user nova-compute[75102]:     </rng>
Nov 10 16:40:23 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:40:23 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:40:23 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:40:23 user nova-compute[75102]:     </memballoon>
Nov 10 16:40:23 user nova-compute[75102]:   </devices>
Nov 10 16:40:23 user nova-compute[75102]: </domain>
Nov 10 16:40:23 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1971436327',display_name='tempest-TestShelveInstance-server-1971436327',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1971436327',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEmWswTifVR81PjbzdI9ymWWUXNhpQ0j1viup1f7qEgXcRBOnJrEhKddKHYWk8zUUQMJCwde0yp39CzlCdLrw7tXOZollMQO4SchG7cVgghMd/x4lwDXcRBqtv/uZ4hsQ==',key_name='tempest-TestShelveInstance-1509801576',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b7089a983faf4dbebfc6f9514a154c83',ramdisk_id='',reservation_id='r-he2uv6iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-188193481',owner_user_name='tempest-TestShelveInstance-188193481-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:39:45Z,user_data=None,user_id='190f5287874a4a04a1436f7c6b5213d7',uuid=b57fe73f-7ce0-4290-9f14-300de96d9e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converting VIF {"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG os_vif [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0780c758-12e9-4a9b-9ed0-ae6ca2468580]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2d16fe1-257d-5e77-8dc1-66e9acd080ac', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41c704f1-d2, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41c704f1-d2, col_values=(('qos', UUID('9f045aa0-f611-4fca-ac65-0bf23479b04a')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41c704f1-d2, col_values=(('external_ids', {'iface-id': '41c704f1-d29a-491b-9f9f-d1d4e3badf13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:34:f2', 'vm-uuid': 'b57fe73f-7ce0-4290-9f14-300de96d9e38'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3630f6cd-6208-4716-a5eb-ea90206b06c8]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:23 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:40:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:23 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:40:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f84143880>, {}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Disconnecting from: [] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.077s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] <== disconnect_volume: return (1197ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:40:23 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Deleting instance files /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095_del
Nov 10 16:40:23 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Deletion of /opt/stack/data/nova/instances/4011f0df-65d5-43a9-bc81-876e451a9095_del complete
Nov 10 16:40:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:23 user nova-compute[75102]: INFO os_vif [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2')
Nov 10 16:40:23 user nova-compute[75102]: INFO nova.compute.manager [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Took 2.13 seconds to destroy the instance on the hypervisor.
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] No VIF found with MAC fa:16:3e:67:34:f2, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-a0f9467a-fbc3-4c4b-a03f-075dd388cfaa req-fb88e435-b3d0-4cb7-829a-08cff28f4dfb service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received event network-vif-plugged-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a0f9467a-fbc3-4c4b-a03f-075dd388cfaa req-fb88e435-b3d0-4cb7-829a-08cff28f4dfb service nova] Acquiring lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a0f9467a-fbc3-4c4b-a03f-075dd388cfaa req-fb88e435-b3d0-4cb7-829a-08cff28f4dfb service nova] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a0f9467a-fbc3-4c4b-a03f-075dd388cfaa req-fb88e435-b3d0-4cb7-829a-08cff28f4dfb service nova] Lock "4011f0df-65d5-43a9-bc81-876e451a9095-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-a0f9467a-fbc3-4c4b-a03f-075dd388cfaa req-fb88e435-b3d0-4cb7-829a-08cff28f4dfb service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] No waiting events found dispatching network-vif-plugged-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:40:23 user nova-compute[75102]: WARNING nova.compute.manager [req-a0f9467a-fbc3-4c4b-a03f-075dd388cfaa req-fb88e435-b3d0-4cb7-829a-08cff28f4dfb service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received unexpected event network-vif-plugged-b467529d-8282-454a-bfe1-c9d6e4f9780a for instance with vm_state active and task_state deleting.
Nov 10 16:40:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:24 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:40:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:24 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Took 1.45 seconds to deallocate network for instance.
Nov 10 16:40:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:24 user nova-compute[75102]: WARNING nova.volume.cinder [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Attachment cf0f66dc-5928-4b5c-8d2d-db030b0f39c9 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = cf0f66dc-5928-4b5c-8d2d-db030b0f39c9. (HTTP 404) (Request-ID: req-6b5db141-96e2-4062-8981-6a0e2f982270)
Nov 10 16:40:24 user nova-compute[75102]: INFO nova.compute.manager [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Took 0.04 seconds to detach 1 volumes for instance.
Nov 10 16:40:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.541s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:25 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Deleted allocations for instance 4011f0df-65d5-43a9-bc81-876e451a9095
Nov 10 16:40:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] [instance: 4011f0df-65d5-43a9-bc81-876e451a9095] Received event network-vif-deleted-b467529d-8282-454a-bfe1-c9d6e4f9780a {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] No waiting events found dispatching network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:40:25 user nova-compute[75102]: WARNING nova.compute.manager [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received unexpected event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 for instance with vm_state building and task_state spawning.
Nov 10 16:40:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] No waiting events found dispatching network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:40:25 user nova-compute[75102]: WARNING nova.compute.manager [req-b799d0ed-821a-4e90-916d-5d8696a30e56 req-fc7a10eb-f996-4dbc-abfb-1469e56c030d service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received unexpected event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 for instance with vm_state building and task_state spawning.
Nov 10 16:40:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4c411ded-e0f2-48e8-a39b-b4d51798ed13 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "4011f0df-65d5-43a9-bc81-876e451a9095" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.580s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:26 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:40:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:40:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Instance spawned successfully.
Nov 10 16:40:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:40:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:40:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:40:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:40:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:40:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:40:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:40:27 user nova-compute[75102]: INFO nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Took 5.61 seconds to spawn the instance on the hypervisor.
Nov 10 16:40:27 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:40:27 user nova-compute[75102]: INFO nova.compute.manager [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Took 42.67 seconds to build instance.
Nov 10 16:40:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f67cb866-792d-4d6a-a451-c2f2a631ccb0 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 42.762s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:40:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVetldOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:40:41 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:40:41 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:40:41 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7822c1eb-d1f4-4d25-beca-4e0c6cb773f0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:40:41 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c477c2-f4ab-4d5b-b317-4f5bda74da43]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b] added
Nov 10 16:40:41 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c12b6b9-2868-4c41-a70d-bcdd23f86eb3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e12984c-0858-43e6-bae1-a1ff514c65f0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVetldOU {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AVetldOU" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aca7448-6929-4d60-a621-587a076c97a1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AVetldOU'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee212828-86d6-460e-bdec-6579f510f245]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4601311b-a635-4a8e-9f23-75ccf59017a3]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:41 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:40:41 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:41 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:40:41 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38c21655-47bc-4617-ab18-9074284a0e8f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b, portal: 172.16.0.220,3260]
Nov 10 16:40:41 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b, portal: 172.16.0.220,3260] successful.
Nov 10 16:40:41 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5415e5a9-5234-4611-95e5-7630e86affc8]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e0fa0b1-35c0-4256-8941-0aae3cecc562]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:41 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:40:41 user nova-compute[75102]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b (non-flash)
Nov 10 16:40:41 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:40:41 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:40:41 user nova-compute[75102]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b (non-flash)
Nov 10 16:40:41 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] HCTL ('35', '-', '-', 0) found on session 36 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5629da-a5e9-4edd-b81a-cba3e4b59c7e]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:40:41 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:40:42 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Searching for a device in session 36 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:40:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVetldOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:40:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:40:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23333336434323838', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:40:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333336434323838', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:40:42 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'flavor' on Instance uuid 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:40:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:40:42 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:40:42 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:40:42 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:40:42 user nova-compute[75102]:   <serial>4bb0d356-a9ec-496d-8977-ab4ed84b8e3b</serial>
Nov 10 16:40:42 user nova-compute[75102]: </disk>
Nov 10 16:40:42 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:40:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:40:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:40:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] No VIF found with MAC fa:16:3e:d8:8a:cb, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:40:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3569ed28-4b54-4e4b-b7dd-cab4b1394aa3 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 28.940s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:40:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:40:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:40:43 user nova-compute[75102]: INFO nova.compute.manager [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Detaching volume 4bb0d356-a9ec-496d-8977-ab4ed84b8e3b
Nov 10 16:40:43 user nova-compute[75102]: INFO nova.virt.block_device [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Attempting to driver detach volume 4bb0d356-a9ec-496d-8977-ab4ed84b8e3b from mountpoint /dev/vdb
Nov 10 16:40:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Attempting to detach device vdb from instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:40:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:40:43 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:40:43 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:40:43 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:40:43 user nova-compute[75102]:   <serial>4bb0d356-a9ec-496d-8977-ab4ed84b8e3b</serial>
Nov 10 16:40:43 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:40:43 user nova-compute[75102]: </disk>
Nov 10 16:40:43 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:40:43 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully detached device vdb from instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 from the persistent domain config.
Nov 10 16:40:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:40:43 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:40:43 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:40:43 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:40:43 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:40:43 user nova-compute[75102]:   <serial>4bb0d356-a9ec-496d-8977-ab4ed84b8e3b</serial>
Nov 10 16:40:43 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:40:43 user nova-compute[75102]: </disk>
Nov 10 16:40:43 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:40:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:40:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:40:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:04 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 is timed out.
Nov 10 16:41:04 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully detached device vdb from instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 from the live domain config.
Nov 10 16:41:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AVetldOU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:41:04 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d43b7345-7796-4d35-b16b-e41106e12ba1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:41:04 user nova-compute[75102]: No targets found.
Nov 10 16:41:04 user nova-compute[75102]: iSNS:
Nov 10 16:41:04 user nova-compute[75102]: No targets found.
Nov 10 16:41:04 user nova-compute[75102]: STATIC:
Nov 10 16:41:04 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334
Nov 10 16:41:04 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:41:04 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:41:04 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b
Nov 10 16:41:04 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:41:04 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:41:04 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24
Nov 10 16:41:04 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:41:04 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:41:04 user nova-compute[75102]: FIRMWARE:
Nov 10 16:41:04 user nova-compute[75102]: No targets found.
Nov 10 16:41:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:41:04 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:41:04 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6717b6-fd23-4908-85c0-a34fd5a2ae40]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ff629a-f1a4-4b64-91fe-40ea3583b1a4]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:41:04 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:41:04 user nova-compute[75102]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b (non-flash)
Nov 10 16:41:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:41:04 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:41:04 user nova-compute[75102]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b (non-flash)
Nov 10 16:41:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f8435cf70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20885678-db2b-4648-b93c-6b45b18e3f21]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd553c89-f7ef-4ed0-9d15-ef5a8382ebb2]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a40303-4b81-4e7f-9636-f00067d3e786]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.050s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5635b0d6-7bec-44b1-ba30-d7a3eded5993]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6994e397-eb9a-4640-b750-d1e62a42c0b4]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac07ed28-b5dc-4e36-9eec-8a1cb4654763]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b, portal: 172.16.0.220,3260]
Nov 10 16:41:04 user nova-compute[75102]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b, portal: 172.16.0.220,3260] successful.
Nov 10 16:41:04 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bb0d356-a9ec-496d-8977-ab4ed84b8e3b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c18efd3-3000-443f-b19c-2186bcfaaa41]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.360s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] <== disconnect_volume: return (361ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:41:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:41:05 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:41:05 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'flavor' on Instance uuid 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:41:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3e39d7ed-25f5-424a-8ba7-46d13c1fbb99 tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.076s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:41:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:41:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7807MB free_disk=25.022319793701172GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Applying migration context for instance da5d6c88-342c-423d-b0f4-5a18774e91f4 as it has an incoming, in-progress migration e8fa2133-07a8-4ddc-8979-fc2d3db675e7. Migration status is finished {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 10 16:41:10 user nova-compute[75102]: INFO nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating resource usage from migration e8fa2133-07a8-4ddc-8979-fc2d3db675e7
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Migration e8fa2133-07a8-4ddc-8979-fc2d3db675e7 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance da5d6c88-342c-423d-b0f4-5a18774e91f4 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b57fe73f-7ce0-4290-9f14-300de96d9e38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.481s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:41:10 user nova-compute[75102]: INFO nova.compute.claims [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Claim successful on node user
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:41:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:41:11 user nova-compute[75102]: INFO nova.virt.block_device [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Booting with volume 37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 at /dev/vda
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.policy [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96544e5daa74d51a232f565129b328a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3cd7409a94429d9262ef8a2a664d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG os_brick.utils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[80734bd2-acd8-4a2b-b2b0-d653366495b6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[af690b9e-b66f-4275-b699-47bd47434507]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[146bd841-d175-441f-ac77-5e2a4719776d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd922cf5-e70c-4b07-8070-eeec80421af6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:41:11 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[db0812db-cb00-4531-bab7-7348fc828b73]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG os_brick.utils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Updating existing volume attachment record: 798ae1e6-d3ba-4658-a61d-dd4cdb8205b0 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Skipping network cache update for instance because it is Building. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:41:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Successfully created port: 9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Going to confirm migration 2 {{(pid=75102) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updating instance_info_cache with network_info: [{"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquired lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.objects.instance [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'info_cache' on Instance uuid da5d6c88-342c-423d-b0f4-5a18774e91f4 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Successfully updated port: 9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquired lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-cb1f0153-b705-4ead-ae25-9ac8de2108f9 req-714192ec-7945-41bd-8379-ef94fd8851e4 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received event network-changed-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-cb1f0153-b705-4ead-ae25-9ac8de2108f9 req-714192ec-7945-41bd-8379-ef94fd8851e4 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Refreshing instance network info cache due to event network-changed-9228e58f-cb9e-4beb-83e3-c1e8460afb0c. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-cb1f0153-b705-4ead-ae25-9ac8de2108f9 req-714192ec-7945-41bd-8379-ef94fd8851e4 service nova] Acquiring lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:41:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating instance_info_cache with network_info: [{"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Releasing lock "refresh_cache-da5d6c88-342c-423d-b0f4-5a18774e91f4" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG nova.objects.instance [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'migration_context' on Instance uuid da5d6c88-342c-423d-b0f4-5a18774e91f4 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG nova.objects.base [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Object Instance<da5d6c88-342c-423d-b0f4-5a18774e91f4> lazy-loaded attributes: info_cache,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG nova.network.neutron [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Updating instance_info_cache with network_info: [{"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Releasing lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Instance network_info: |[{"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-cb1f0153-b705-4ead-ae25-9ac8de2108f9 req-714192ec-7945-41bd-8379-ef94fd8851e4 service nova] Acquired lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-cb1f0153-b705-4ead-ae25-9ac8de2108f9 req-714192ec-7945-41bd-8379-ef94fd8851e4 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Refreshing network info cache for port 9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.484s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:13 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Deleted allocation for migration e8fa2133-07a8-4ddc-8979-fc2d3db675e7
Nov 10 16:41:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-cb1f0153-b705-4ead-ae25-9ac8de2108f9 req-714192ec-7945-41bd-8379-ef94fd8851e4 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Updated VIF entry in instance network info cache for port 9228e58f-cb9e-4beb-83e3-c1e8460afb0c. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-cb1f0153-b705-4ead-ae25-9ac8de2108f9 req-714192ec-7945-41bd-8379-ef94fd8851e4 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Updating instance_info_cache with network_info: [{"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-cb1f0153-b705-4ead-ae25-9ac8de2108f9 req-714192ec-7945-41bd-8379-ef94fd8851e4 service nova] Releasing lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:41:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6a294a87-9bac-4333-a67c-0e43d39a6eca tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.662s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:41:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:41:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:41:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:41:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5173 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:41:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:41:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:34 user nova-compute[75102]: INFO nova.compute.manager [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Terminating instance
Nov 10 16:41:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-a6131799-88d7-4fe0-a3aa-a9a3f9a7def7 req-2a1c7439-19f4-46ad-aa44-3a8baeebfc38 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received event network-vif-unplugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a6131799-88d7-4fe0-a3aa-a9a3f9a7def7 req-2a1c7439-19f4-46ad-aa44-3a8baeebfc38 service nova] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a6131799-88d7-4fe0-a3aa-a9a3f9a7def7 req-2a1c7439-19f4-46ad-aa44-3a8baeebfc38 service nova] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a6131799-88d7-4fe0-a3aa-a9a3f9a7def7 req-2a1c7439-19f4-46ad-aa44-3a8baeebfc38 service nova] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-a6131799-88d7-4fe0-a3aa-a9a3f9a7def7 req-2a1c7439-19f4-46ad-aa44-3a8baeebfc38 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] No waiting events found dispatching network-vif-unplugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-a6131799-88d7-4fe0-a3aa-a9a3f9a7def7 req-2a1c7439-19f4-46ad-aa44-3a8baeebfc38 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received event network-vif-unplugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:35 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Instance destroyed successfully.
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.objects.instance [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lazy-loading 'resources' on Instance uuid 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:38:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-225540388',display_name='tempest-AttachVolumeNegativeTest-server-225540388',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-225540388',id=39,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK13XLuGYbxuREuBn5qBwiCoZef0tiQYRhmFgxBhmq7WshPhZoHgOwDuvDZdXsuA9m8GAPuTJvGSWyTMhoM0yibhacqFGqKjbmg/10VmOlOM6kjodGct95qT69f/GYFRMQ==',key_name='tempest-keypair-1089500709',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6e388a924d2546fabfefe82c241ecbb1',ramdisk_id='',reservation_id='r-rdr0u09h',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1745402198',owner_user_name='tempest-AttachVolumeNegativeTest-1745402198-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:38:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e290c40d1bac47f9aa06185efefbb4bd',uuid=0a2899c4-fca3-4f7b-bffd-7642b9abfbe6,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converting VIF {"id": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "address": "fa:16:3e:d8:8a:cb", "network": {"id": "6678beea-d8b6-4f8d-a907-27e9620bac94", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-984956022-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.2", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6e388a924d2546fabfefe82c241ecbb1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb53fde8e-54", "ovs_interfaceid": "b53fde8e-547c-4e1c-af0a-d3f4108b146f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d8:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=b53fde8e-547c-4e1c-af0a-d3f4108b146f,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53fde8e-54') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG os_vif [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=b53fde8e-547c-4e1c-af0a-d3f4108b146f,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53fde8e-54') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb53fde8e-54, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=016b0d20-feac-408b-8055-26a684f10f68) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:35 user nova-compute[75102]: INFO os_vif [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d8:8a:cb,bridge_name='br-int',has_traffic_filtering=True,id=b53fde8e-547c-4e1c-af0a-d3f4108b146f,network=Network(6678beea-d8b6-4f8d-a907-27e9620bac94),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb53fde8e-54')
Nov 10 16:41:35 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Deleting instance files /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6_del
Nov 10 16:41:35 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Deletion of /opt/stack/data/nova/instances/0a2899c4-fca3-4f7b-bffd-7642b9abfbe6_del complete
Nov 10 16:41:35 user nova-compute[75102]: INFO nova.compute.manager [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 16:41:35 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:41:35 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Took 0.69 seconds to deallocate network for instance.
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-bc37bea9-d6f6-4f99-aa4c-1317642f0129 req-69d06889-f7b4-426d-ae4a-9a4b09fd2c62 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received event network-vif-deleted-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:35 user nova-compute[75102]: INFO nova.compute.manager [req-bc37bea9-d6f6-4f99-aa4c-1317642f0129 req-69d06889-f7b4-426d-ae4a-9a4b09fd2c62 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Neutron deleted interface b53fde8e-547c-4e1c-af0a-d3f4108b146f; detaching it from the instance and deleting it from the info cache
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.network.neutron [req-bc37bea9-d6f6-4f99-aa4c-1317642f0129 req-69d06889-f7b4-426d-ae4a-9a4b09fd2c62 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG nova.compute.manager [req-bc37bea9-d6f6-4f99-aa4c-1317642f0129 req-69d06889-f7b4-426d-ae4a-9a4b09fd2c62 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Detach interface failed, port_id=b53fde8e-547c-4e1c-af0a-d3f4108b146f, reason: Instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.291s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:36 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Deleted allocations for instance 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6
Nov 10 16:41:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8fe31175-2842-4b9c-b88a-9ee92c713d9d tempest-AttachVolumeNegativeTest-1745402198 tempest-AttachVolumeNegativeTest-1745402198-project-member] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-6becd318-2cc3-4975-9d35-68ac8f7bfe74 req-dfef3e5f-8c00-4d39-9888-f595d83f7df6 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received event network-vif-plugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6becd318-2cc3-4975-9d35-68ac8f7bfe74 req-dfef3e5f-8c00-4d39-9888-f595d83f7df6 service nova] Acquiring lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6becd318-2cc3-4975-9d35-68ac8f7bfe74 req-dfef3e5f-8c00-4d39-9888-f595d83f7df6 service nova] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6becd318-2cc3-4975-9d35-68ac8f7bfe74 req-dfef3e5f-8c00-4d39-9888-f595d83f7df6 service nova] Lock "0a2899c4-fca3-4f7b-bffd-7642b9abfbe6-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-6becd318-2cc3-4975-9d35-68ac8f7bfe74 req-dfef3e5f-8c00-4d39-9888-f595d83f7df6 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] No waiting events found dispatching network-vif-plugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:41:36 user nova-compute[75102]: WARNING nova.compute.manager [req-6becd318-2cc3-4975-9d35-68ac8f7bfe74 req-dfef3e5f-8c00-4d39-9888-f595d83f7df6 service nova] [instance: 0a2899c4-fca3-4f7b-bffd-7642b9abfbe6] Received unexpected event network-vif-plugged-b53fde8e-547c-4e1c-af0a-d3f4108b146f for instance with vm_state deleted and task_state None.
Nov 10 16:41:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-474d47c8-c6da-464d-96b5-32e35b7f8af2 req-7125c922-caf5-4d0e-8070-14f06f6b6614 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG nova.compute.manager [req-474d47c8-c6da-464d-96b5-32e35b7f8af2 req-7125c922-caf5-4d0e-8070-14f06f6b6614 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing instance network info cache due to event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-474d47c8-c6da-464d-96b5-32e35b7f8af2 req-7125c922-caf5-4d0e-8070-14f06f6b6614 service nova] Acquiring lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-474d47c8-c6da-464d-96b5-32e35b7f8af2 req-7125c922-caf5-4d0e-8070-14f06f6b6614 service nova] Acquired lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:41:36 user nova-compute[75102]: DEBUG nova.network.neutron [req-474d47c8-c6da-464d-96b5-32e35b7f8af2 req-7125c922-caf5-4d0e-8070-14f06f6b6614 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG nova.network.neutron [req-474d47c8-c6da-464d-96b5-32e35b7f8af2 req-7125c922-caf5-4d0e-8070-14f06f6b6614 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updated VIF entry in instance network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG nova.network.neutron [req-474d47c8-c6da-464d-96b5-32e35b7f8af2 req-7125c922-caf5-4d0e-8070-14f06f6b6614 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-474d47c8-c6da-464d-96b5-32e35b7f8af2 req-7125c922-caf5-4d0e-8070-14f06f6b6614 service nova] Releasing lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:37 user nova-compute[75102]: INFO nova.compute.manager [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Shelve offloading
Nov 10 16:41:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-unplugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] No waiting events found dispatching network-vif-unplugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:41:37 user nova-compute[75102]: WARNING nova.compute.manager [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received unexpected event network-vif-unplugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 for instance with vm_state active and task_state shelving.
Nov 10 16:41:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:37 user nova-compute[75102]: DEBUG nova.compute.manager [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] No waiting events found dispatching network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:41:37 user nova-compute[75102]: WARNING nova.compute.manager [req-1716b40d-8be6-41c8-87bc-772b8934b8af req-4def16eb-fce5-4cf6-b1b0-5e86f6e5c98a service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received unexpected event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 for instance with vm_state active and task_state shelving.
Nov 10 16:41:38 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Instance destroyed successfully.
Nov 10 16:41:38 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquired lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Releasing lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:41:38 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Instance destroyed successfully.
Nov 10 16:41:38 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lazy-loading 'resources' on Instance uuid b57fe73f-7ce0-4290-9f14-300de96d9e38 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1971436327',display_name='tempest-TestShelveInstance-server-1971436327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1971436327',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEmWswTifVR81PjbzdI9ymWWUXNhpQ0j1viup1f7qEgXcRBOnJrEhKddKHYWk8zUUQMJCwde0yp39CzlCdLrw7tXOZollMQO4SchG7cVgghMd/x4lwDXcRBqtv/uZ4hsQ==',key_name='tempest-TestShelveInstance-1509801576',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7089a983faf4dbebfc6f9514a154c83',ramdisk_id='',reservation_id='r-he2uv6iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-188193481',owner_user_name='tempest-TestShelveInstance-188193481-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:40:27Z,user_data=None,user_id='190f5287874a4a04a1436f7c6b5213d7',uuid=b57fe73f-7ce0-4290-9f14-300de96d9e38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converting VIF {"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG os_vif [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41c704f1-d2, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9f045aa0-f611-4fca-ac65-0bf23479b04a) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:41:38 user nova-compute[75102]: INFO os_vif [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2')
Nov 10 16:41:38 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmLjEcxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:41:38 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:41:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:41:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[30426211-3bad-47de-9f4a-9db59d72a547]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:41:39 user nova-compute[75102]: No targets found.
Nov 10 16:41:39 user nova-compute[75102]: iSNS:
Nov 10 16:41:39 user nova-compute[75102]: No targets found.
Nov 10 16:41:39 user nova-compute[75102]: STATIC:
Nov 10 16:41:39 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334
Nov 10 16:41:39 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:41:39 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:41:39 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24
Nov 10 16:41:39 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:41:39 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:41:39 user nova-compute[75102]: FIRMWARE:
Nov 10 16:41:39 user nova-compute[75102]: No targets found.
Nov 10 16:41:39 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:41:39 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:41:39 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab39e316-76c4-42eb-aa38-59b1ffc8cb50]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dc9803-add3-46c3-988a-1f0d12b164ba]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:41:39 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:41:39 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:41:39 user nova-compute[75102]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:41:39 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7456b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9332d18e-99a8-488b-9997-4cdbe5dff029]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bdec53-9aa5-470f-8b7e-6f73c589c5f8]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c806efb4-ec5f-4310-8626-0769726ffd9a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[35e5cbfa-a9d5-474d-9da9-504929e41a64]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee8b97f-f78a-47bc-93cf-00d534149549]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f932b932-0f7f-4ba0-bc22-ef098373d343]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260]
Nov 10 16:41:39 user nova-compute[75102]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260] successful.
Nov 10 16:41:39 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12142d9-71ac-4ae4-956f-dcbdf86fde8b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] <== disconnect_volume: return (300ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:41:39 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Deleting instance files /opt/stack/data/nova/instances/b57fe73f-7ce0-4290-9f14-300de96d9e38_del
Nov 10 16:41:39 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Deletion of /opt/stack/data/nova/instances/b57fe73f-7ce0-4290-9f14-300de96d9e38_del complete
Nov 10 16:41:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-c3f15752-05dd-4bcc-a827-09e3a4fa6657 req-f914543f-d3b3-4bb2-8de2-ad1d33d843b5 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-c3f15752-05dd-4bcc-a827-09e3a4fa6657 req-f914543f-d3b3-4bb2-8de2-ad1d33d843b5 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing instance network info cache due to event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c3f15752-05dd-4bcc-a827-09e3a4fa6657 req-f914543f-d3b3-4bb2-8de2-ad1d33d843b5 service nova] Acquiring lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c3f15752-05dd-4bcc-a827-09e3a4fa6657 req-f914543f-d3b3-4bb2-8de2-ad1d33d843b5 service nova] Acquired lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:41:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-c3f15752-05dd-4bcc-a827-09e3a4fa6657 req-f914543f-d3b3-4bb2-8de2-ad1d33d843b5 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:41:40 user nova-compute[75102]: DEBUG nova.network.neutron [req-c3f15752-05dd-4bcc-a827-09e3a4fa6657 req-f914543f-d3b3-4bb2-8de2-ad1d33d843b5 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updated VIF entry in instance network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:41:40 user nova-compute[75102]: DEBUG nova.network.neutron [req-c3f15752-05dd-4bcc-a827-09e3a4fa6657 req-f914543f-d3b3-4bb2-8de2-ad1d33d843b5 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": null, "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap41c704f1-d2", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:41:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c3f15752-05dd-4bcc-a827-09e3a4fa6657 req-f914543f-d3b3-4bb2-8de2-ad1d33d843b5 service nova] Releasing lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:41:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:40 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Deleted allocations for instance b57fe73f-7ce0-4290-9f14-300de96d9e38
Nov 10 16:41:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:40 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lazy-loading 'numa_topology' on Instance uuid b57fe73f-7ce0-4290-9f14-300de96d9e38 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:41:40 user nova-compute[75102]: DEBUG nova.objects.base [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Object Instance<b57fe73f-7ce0-4290-9f14-300de96d9e38> lazy-loaded attributes: resources,numa_topology {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:41:40 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:41:40 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:41:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.256s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f5a6f380-c5c6-4478-a660-64a6a33410ae tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.739s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:41:46 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Creating image(s)
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Ensure instance console log exists: /opt/stack/data/nova/instances/2237c70c-96db-4b53-98a4-24ae8d0c3abe/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Start _get_guest_xml network_info=[{"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '798ae1e6-d3ba-4658-a61d-dd4cdb8205b0', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkJzYZqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '2237c70c-96db-4b53-98a4-24ae8d0c3abe', 'attached_at': '', 'detached_at': '', 'volume_id': '37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35', 'serial': '37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:41:46 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:41:46 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkJzYZqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:41:46 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:41:46 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:41:46 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[344a1f89-eaae-42cb-8086-59845337c44f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:41:46 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffddea7d-94f1-401d-bec9-3a8f38ad5f93]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35] added
Nov 10 16:41:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[55accf20-dc0f-4dd4-817d-28894e59d9f6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[136a5401-ff32-48a8-88fc-c3dcd2f5bc2f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkJzYZqv {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IkJzYZqv" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f32bd0c0-caa3-4d21-8055-64cabe693d39]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IkJzYZqv'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bec2d72-d566-4243-be01-99356ea71abb]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ffcac2-6716-46ef-b617-d629c15be141]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:41:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:41:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c36725d2-c514-49af-8294-9f448fcca662]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35, portal: 172.16.0.220,3260]
Nov 10 16:41:46 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35, portal: 172.16.0.220,3260] successful.
Nov 10 16:41:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f69b56-ff7c-439b-a335-31df7f826a27]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec432f7-e962-47a0-b9bd-1cefe27084f4]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:41:46 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:41:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:41:46 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:41:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] HCTL ('34', '-', '-', 0) found on session 37 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[06557f12-8a0b-4762-994b-d3f9f8be42da]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:41:46 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching for a device in session 37 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkJzYZqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.301s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== connect_volume: return (1303ms) {'type': 'block', 'scsi_wwn': '26164363534366364', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26164363534366364', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1929673096',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1929673096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1929673096',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOD8ebqs7aaPdEvf/DGH76J9LCL7eZL5DDNqLRYwQD6kYoCiojMOTRjKyKaucofMTl5gjjikxeZrnr7ZCBoRMg2PIDwfGSgWEhLC1eeln6Mix/5YgaDff0bap2AiCokXQ==',key_name='tempest-keypair-511649803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-63olmeo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:41:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96544e5daa74d51a232f565129b328a',uuid=2237c70c-96db-4b53-98a4-24ae8d0c3abe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:26:56,bridge_name='br-int',has_traffic_filtering=True,id=9228e58f-cb9e-4beb-83e3-c1e8460afb0c,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9228e58f-cb') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.objects.instance [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'pci_devices' on Instance uuid 2237c70c-96db-4b53-98a4-24ae8d0c3abe {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:41:47 user nova-compute[75102]:   <uuid>2237c70c-96db-4b53-98a4-24ae8d0c3abe</uuid>
Nov 10 16:41:47 user nova-compute[75102]:   <name>instance-00000029</name>
Nov 10 16:41:47 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:41:47 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:41:47 user nova-compute[75102]:   <metadata>
Nov 10 16:41:47 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:41:47 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:41:47 user nova-compute[75102]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1929673096</nova:name>
Nov 10 16:41:47 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:41:46</nova:creationTime>
Nov 10 16:41:47 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:41:47 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:41:47 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:41:47 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:41:47 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:41:47 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:41:47 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:41:47 user nova-compute[75102]:       <nova:owner>
Nov 10 16:41:47 user nova-compute[75102]:         <nova:user uuid="e96544e5daa74d51a232f565129b328a">tempest-TestVolumeBootPattern-1535704831-project-member</nova:user>
Nov 10 16:41:47 user nova-compute[75102]:         <nova:project uuid="fe3cd7409a94429d9262ef8a2a664d7c">tempest-TestVolumeBootPattern-1535704831</nova:project>
Nov 10 16:41:47 user nova-compute[75102]:       </nova:owner>
Nov 10 16:41:47 user nova-compute[75102]:       <nova:ports>
Nov 10 16:41:47 user nova-compute[75102]:         <nova:port uuid="9228e58f-cb9e-4beb-83e3-c1e8460afb0c">
Nov 10 16:41:47 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 16:41:47 user nova-compute[75102]:         </nova:port>
Nov 10 16:41:47 user nova-compute[75102]:       </nova:ports>
Nov 10 16:41:47 user nova-compute[75102]:     </nova:instance>
Nov 10 16:41:47 user nova-compute[75102]:   </metadata>
Nov 10 16:41:47 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:41:47 user nova-compute[75102]:     <system>
Nov 10 16:41:47 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:41:47 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:41:47 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:41:47 user nova-compute[75102]:       <entry name="serial">2237c70c-96db-4b53-98a4-24ae8d0c3abe</entry>
Nov 10 16:41:47 user nova-compute[75102]:       <entry name="uuid">2237c70c-96db-4b53-98a4-24ae8d0c3abe</entry>
Nov 10 16:41:47 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:41:47 user nova-compute[75102]:     </system>
Nov 10 16:41:47 user nova-compute[75102]:   </sysinfo>
Nov 10 16:41:47 user nova-compute[75102]:   <os>
Nov 10 16:41:47 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:41:47 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:41:47 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:41:47 user nova-compute[75102]:   </os>
Nov 10 16:41:47 user nova-compute[75102]:   <features>
Nov 10 16:41:47 user nova-compute[75102]:     <acpi/>
Nov 10 16:41:47 user nova-compute[75102]:     <apic/>
Nov 10 16:41:47 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:41:47 user nova-compute[75102]:   </features>
Nov 10 16:41:47 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:41:47 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:41:47 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:41:47 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:41:47 user nova-compute[75102]:   </clock>
Nov 10 16:41:47 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:41:47 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:41:47 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:41:47 user nova-compute[75102]:   </cpu>
Nov 10 16:41:47 user nova-compute[75102]:   <devices>
Nov 10 16:41:47 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:41:47 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:41:47 user nova-compute[75102]:       <source dev="/dev/sdc"/>
Nov 10 16:41:47 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:41:47 user nova-compute[75102]:       <serial>37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35</serial>
Nov 10 16:41:47 user nova-compute[75102]:     </disk>
Nov 10 16:41:47 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:41:47 user nova-compute[75102]:       <mac address="fa:16:3e:44:26:56"/>
Nov 10 16:41:47 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:41:47 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:41:47 user nova-compute[75102]:       <target dev="tap9228e58f-cb"/>
Nov 10 16:41:47 user nova-compute[75102]:     </interface>
Nov 10 16:41:47 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:41:47 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/2237c70c-96db-4b53-98a4-24ae8d0c3abe/console.log" append="off"/>
Nov 10 16:41:47 user nova-compute[75102]:     </serial>
Nov 10 16:41:47 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:41:47 user nova-compute[75102]:     <video>
Nov 10 16:41:47 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:41:47 user nova-compute[75102]:     </video>
Nov 10 16:41:47 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:41:47 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:41:47 user nova-compute[75102]:     </rng>
Nov 10 16:41:47 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:41:47 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:41:47 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:41:47 user nova-compute[75102]:     </memballoon>
Nov 10 16:41:47 user nova-compute[75102]:   </devices>
Nov 10 16:41:47 user nova-compute[75102]: </domain>
Nov 10 16:41:47 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1929673096',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1929673096',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1929673096',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOD8ebqs7aaPdEvf/DGH76J9LCL7eZL5DDNqLRYwQD6kYoCiojMOTRjKyKaucofMTl5gjjikxeZrnr7ZCBoRMg2PIDwfGSgWEhLC1eeln6Mix/5YgaDff0bap2AiCokXQ==',key_name='tempest-keypair-511649803',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-63olmeo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:41:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96544e5daa74d51a232f565129b328a',uuid=2237c70c-96db-4b53-98a4-24ae8d0c3abe,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:44:26:56,bridge_name='br-int',has_traffic_filtering=True,id=9228e58f-cb9e-4beb-83e3-c1e8460afb0c,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9228e58f-cb') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG os_vif [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:26:56,bridge_name='br-int',has_traffic_filtering=True,id=9228e58f-cb9e-4beb-83e3-c1e8460afb0c,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9228e58f-cb') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1628e25f-07ab-5eb9-bb4c-4e271537cd03', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9228e58f-cb, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9228e58f-cb, col_values=(('qos', UUID('3a4650ce-a2b0-494c-b4a1-3ee5dad3339a')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9228e58f-cb, col_values=(('external_ids', {'iface-id': '9228e58f-cb9e-4beb-83e3-c1e8460afb0c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:44:26:56', 'vm-uuid': '2237c70c-96db-4b53-98a4-24ae8d0c3abe'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:47 user nova-compute[75102]: INFO os_vif [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:44:26:56,bridge_name='br-int',has_traffic_filtering=True,id=9228e58f-cb9e-4beb-83e3-c1e8460afb0c,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9228e58f-cb')
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:41:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No VIF found with MAC fa:16:3e:44:26:56, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:41:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-e51bd471-9f5a-4510-b4ab-2aeee32ed01b req-9c81f588-b4e3-4afa-826a-b1808554ae97 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received event network-vif-plugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e51bd471-9f5a-4510-b4ab-2aeee32ed01b req-9c81f588-b4e3-4afa-826a-b1808554ae97 service nova] Acquiring lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e51bd471-9f5a-4510-b4ab-2aeee32ed01b req-9c81f588-b4e3-4afa-826a-b1808554ae97 service nova] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e51bd471-9f5a-4510-b4ab-2aeee32ed01b req-9c81f588-b4e3-4afa-826a-b1808554ae97 service nova] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-e51bd471-9f5a-4510-b4ab-2aeee32ed01b req-9c81f588-b4e3-4afa-826a-b1808554ae97 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] No waiting events found dispatching network-vif-plugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:41:49 user nova-compute[75102]: WARNING nova.compute.manager [req-e51bd471-9f5a-4510-b4ab-2aeee32ed01b req-9c81f588-b4e3-4afa-826a-b1808554ae97 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received unexpected event network-vif-plugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c for instance with vm_state building and task_state spawning.
Nov 10 16:41:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:41:51 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Instance spawned successfully.
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:41:51 user nova-compute[75102]: INFO nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Took 5.10 seconds to spawn the instance on the hypervisor.
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-5bbb1e5f-91a0-4765-9c31-c2d432321e1c req-1ab872ba-db59-4e72-90f3-9e58960ea749 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received event network-vif-plugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5bbb1e5f-91a0-4765-9c31-c2d432321e1c req-1ab872ba-db59-4e72-90f3-9e58960ea749 service nova] Acquiring lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5bbb1e5f-91a0-4765-9c31-c2d432321e1c req-1ab872ba-db59-4e72-90f3-9e58960ea749 service nova] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5bbb1e5f-91a0-4765-9c31-c2d432321e1c req-1ab872ba-db59-4e72-90f3-9e58960ea749 service nova] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-5bbb1e5f-91a0-4765-9c31-c2d432321e1c req-1ab872ba-db59-4e72-90f3-9e58960ea749 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] No waiting events found dispatching network-vif-plugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:41:51 user nova-compute[75102]: WARNING nova.compute.manager [req-5bbb1e5f-91a0-4765-9c31-c2d432321e1c req-1ab872ba-db59-4e72-90f3-9e58960ea749 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received unexpected event network-vif-plugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c for instance with vm_state building and task_state spawning.
Nov 10 16:41:51 user nova-compute[75102]: INFO nova.compute.manager [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Took 40.76 seconds to build instance.
Nov 10 16:41:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-770f6c5e-0348-4376-bab2-08c0519311db tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 40.854s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:41:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:41:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:05 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:08 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.224s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:10 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:42:10 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=7995MB free_disk=25.038909912109375GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3f35d18d-c23d-4628-80e7-52e0288fc39e has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance da5d6c88-342c-423d-b0f4-5a18774e91f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 2237c70c-96db-4b53-98a4-24ae8d0c3abe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:42:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 16:42:11 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 16:42:11 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:42:11 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:42:11 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:42:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.722s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Updating instance_info_cache with network_info: [{"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:42:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:15 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 16:42:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 16:42:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:20 user nova-compute[75102]: INFO nova.compute.manager [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Terminating instance
Nov 10 16:42:20 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-f246febf-2bab-4d51-8e83-acdb7c75de39 req-a551b617-4a48-4f19-91f4-37c9237b426c service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received event network-vif-unplugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f246febf-2bab-4d51-8e83-acdb7c75de39 req-a551b617-4a48-4f19-91f4-37c9237b426c service nova] Acquiring lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f246febf-2bab-4d51-8e83-acdb7c75de39 req-a551b617-4a48-4f19-91f4-37c9237b426c service nova] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f246febf-2bab-4d51-8e83-acdb7c75de39 req-a551b617-4a48-4f19-91f4-37c9237b426c service nova] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-f246febf-2bab-4d51-8e83-acdb7c75de39 req-a551b617-4a48-4f19-91f4-37c9237b426c service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] No waiting events found dispatching network-vif-unplugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-f246febf-2bab-4d51-8e83-acdb7c75de39 req-a551b617-4a48-4f19-91f4-37c9237b426c service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received event network-vif-unplugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Instance destroyed successfully.
Nov 10 16:42:21 user nova-compute[75102]: DEBUG nova.objects.instance [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lazy-loading 'resources' on Instance uuid 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:33:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1923502921',display_name='tempest-ServersNegativeTestJSON-server-1923502921',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1923502921',id=32,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:33:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='221beb548fbb455ca011f3a3fc7c4d34',ramdisk_id='',reservation_id='r-8dsmxdnw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1842056783',owner_user_name='tempest-ServersNegativeTestJSON-1842056783-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:33:17Z,user_data=None,user_id='a6ef288da57b4a26b32fd2d368fa85a6',uuid=4ac04f9f-f403-4204-a3d0-1c9e0c4ca442,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converting VIF {"id": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "address": "fa:16:3e:c2:11:42", "network": {"id": "f41cc394-fb15-4830-9fc1-f2e9631e010d", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-373264154-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "221beb548fbb455ca011f3a3fc7c4d34", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f9fbe75-ca", "ovs_interfaceid": "0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:11:42,bridge_name='br-int',has_traffic_filtering=True,id=0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f9fbe75-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG os_vif [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:11:42,bridge_name='br-int',has_traffic_filtering=True,id=0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f9fbe75-ca') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f9fbe75-ca, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=99946a25-4fc3-4cbd-b34d-598ff117bdea) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:21 user nova-compute[75102]: INFO os_vif [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:11:42,bridge_name='br-int',has_traffic_filtering=True,id=0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11,network=Network(f41cc394-fb15-4830-9fc1-f2e9631e010d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f9fbe75-ca')
Nov 10 16:42:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Deleting instance files /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442_del
Nov 10 16:42:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Deletion of /opt/stack/data/nova/instances/4ac04f9f-f403-4204-a3d0-1c9e0c4ca442_del complete
Nov 10 16:42:21 user nova-compute[75102]: INFO nova.compute.manager [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 10 16:42:21 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:42:21 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Took 0.39 seconds to deallocate network for instance.
Nov 10 16:42:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:22 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:42:22 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:42:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.276s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:22 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Deleted allocations for instance 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442
Nov 10 16:42:22 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4cbe4927-7897-4d21-8034-c84f4cf70aaf tempest-ServersNegativeTestJSON-1842056783 tempest-ServersNegativeTestJSON-1842056783-project-member] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.838s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-7aca6794-762c-4dd6-8cb6-c0c8ca354613 req-675033ee-224a-4db1-a11e-4f6fbe705ba5 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received event network-vif-plugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7aca6794-762c-4dd6-8cb6-c0c8ca354613 req-675033ee-224a-4db1-a11e-4f6fbe705ba5 service nova] Acquiring lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7aca6794-762c-4dd6-8cb6-c0c8ca354613 req-675033ee-224a-4db1-a11e-4f6fbe705ba5 service nova] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7aca6794-762c-4dd6-8cb6-c0c8ca354613 req-675033ee-224a-4db1-a11e-4f6fbe705ba5 service nova] Lock "4ac04f9f-f403-4204-a3d0-1c9e0c4ca442-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-7aca6794-762c-4dd6-8cb6-c0c8ca354613 req-675033ee-224a-4db1-a11e-4f6fbe705ba5 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] No waiting events found dispatching network-vif-plugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:42:23 user nova-compute[75102]: WARNING nova.compute.manager [req-7aca6794-762c-4dd6-8cb6-c0c8ca354613 req-675033ee-224a-4db1-a11e-4f6fbe705ba5 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received unexpected event network-vif-plugged-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 for instance with vm_state deleted and task_state None.
Nov 10 16:42:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-7aca6794-762c-4dd6-8cb6-c0c8ca354613 req-675033ee-224a-4db1-a11e-4f6fbe705ba5 service nova] [instance: 4ac04f9f-f403-4204-a3d0-1c9e0c4ca442] Received event network-vif-deleted-0f9fbe75-ca5f-461b-9b44-2a4f2d3aaf11 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "34956fa9-e329-4681-8e37-1bb18def29cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:27 user nova-compute[75102]: DEBUG nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:42:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:27 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:42:27 user nova-compute[75102]: INFO nova.compute.claims [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Claim successful on node user
Nov 10 16:42:28 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG nova.network.neutron [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:42:28 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:42:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:42:28 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Creating image(s)
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "/opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "/opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "/opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.028s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG nova.policy [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f78829a85087437da8edf53a02ae7358', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '09b9ad4975bb43fdbb94dd2742b3d590', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.196s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk 1073741824" returned: 0 in 0.050s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Checking if we can resize image /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Successfully created port: add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json" returned: 0 in 0.273s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Cannot resize image /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Ensure instance console log exists: /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Successfully updated port: add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "refresh_cache-34956fa9-e329-4681-8e37-1bb18def29cb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquired lock "refresh_cache-34956fa9-e329-4681-8e37-1bb18def29cb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-20374ccd-f046-4ea8-94eb-2777b3c171c0 req-b1f1be5c-bce6-457e-bc74-e431eff06753 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Received event network-changed-add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-20374ccd-f046-4ea8-94eb-2777b3c171c0 req-b1f1be5c-bce6-457e-bc74-e431eff06753 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Refreshing instance network info cache due to event network-changed-add0526b-29b8-4df4-b358-c5e79142a734. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-20374ccd-f046-4ea8-94eb-2777b3c171c0 req-b1f1be5c-bce6-457e-bc74-e431eff06753 service nova] Acquiring lock "refresh_cache-34956fa9-e329-4681-8e37-1bb18def29cb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Updating instance_info_cache with network_info: [{"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Releasing lock "refresh_cache-34956fa9-e329-4681-8e37-1bb18def29cb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Instance network_info: |[{"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-20374ccd-f046-4ea8-94eb-2777b3c171c0 req-b1f1be5c-bce6-457e-bc74-e431eff06753 service nova] Acquired lock "refresh_cache-34956fa9-e329-4681-8e37-1bb18def29cb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.neutron [req-20374ccd-f046-4ea8-94eb-2777b3c171c0 req-b1f1be5c-bce6-457e-bc74-e431eff06753 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Refreshing network info cache for port add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Start _get_guest_xml network_info=[{"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:42:30 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:42:30 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:42:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-193396418',display_name='tempest-VolumesSnapshotTestJSON-instance-193396418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-193396418',id=42,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJNlyNeVGRaQw9uIZZS4SV76DhLgXDPGx7JBSwbY1ZKIZgWKQCgFaMb1wsI0L2V8pBMbiLA2kAtKamKexoaFrvjNnxI3WahLIV/V7ACUo/destg9Lh7BudK7MDiibeCdw==',key_name='tempest-keypair-402581287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b9ad4975bb43fdbb94dd2742b3d590',ramdisk_id='',reservation_id='r-9o0hp8jg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-803710656',owner_user_name='tempest-VolumesSnapshotTestJSON-803710656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78829a85087437da8edf53a02ae7358',uuid=34956fa9-e329-4681-8e37-1bb18def29cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converting VIF {"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ab:38,bridge_name='br-int',has_traffic_filtering=True,id=add0526b-29b8-4df4-b358-c5e79142a734,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd0526b-29') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.objects.instance [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'pci_devices' on Instance uuid 34956fa9-e329-4681-8e37-1bb18def29cb {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:42:30 user nova-compute[75102]:   <uuid>34956fa9-e329-4681-8e37-1bb18def29cb</uuid>
Nov 10 16:42:30 user nova-compute[75102]:   <name>instance-0000002a</name>
Nov 10 16:42:30 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:42:30 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:42:30 user nova-compute[75102]:   <metadata>
Nov 10 16:42:30 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:42:30 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:42:30 user nova-compute[75102]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-193396418</nova:name>
Nov 10 16:42:30 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:42:30</nova:creationTime>
Nov 10 16:42:30 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:42:30 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:42:30 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:42:30 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:42:30 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:42:30 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:42:30 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:42:30 user nova-compute[75102]:       <nova:owner>
Nov 10 16:42:30 user nova-compute[75102]:         <nova:user uuid="f78829a85087437da8edf53a02ae7358">tempest-VolumesSnapshotTestJSON-803710656-project-member</nova:user>
Nov 10 16:42:30 user nova-compute[75102]:         <nova:project uuid="09b9ad4975bb43fdbb94dd2742b3d590">tempest-VolumesSnapshotTestJSON-803710656</nova:project>
Nov 10 16:42:30 user nova-compute[75102]:       </nova:owner>
Nov 10 16:42:30 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:42:30 user nova-compute[75102]:       <nova:ports>
Nov 10 16:42:30 user nova-compute[75102]:         <nova:port uuid="add0526b-29b8-4df4-b358-c5e79142a734">
Nov 10 16:42:30 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 16:42:30 user nova-compute[75102]:         </nova:port>
Nov 10 16:42:30 user nova-compute[75102]:       </nova:ports>
Nov 10 16:42:30 user nova-compute[75102]:     </nova:instance>
Nov 10 16:42:30 user nova-compute[75102]:   </metadata>
Nov 10 16:42:30 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:42:30 user nova-compute[75102]:     <system>
Nov 10 16:42:30 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:42:30 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:42:30 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:42:30 user nova-compute[75102]:       <entry name="serial">34956fa9-e329-4681-8e37-1bb18def29cb</entry>
Nov 10 16:42:30 user nova-compute[75102]:       <entry name="uuid">34956fa9-e329-4681-8e37-1bb18def29cb</entry>
Nov 10 16:42:30 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:42:30 user nova-compute[75102]:     </system>
Nov 10 16:42:30 user nova-compute[75102]:   </sysinfo>
Nov 10 16:42:30 user nova-compute[75102]:   <os>
Nov 10 16:42:30 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:42:30 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:42:30 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:42:30 user nova-compute[75102]:   </os>
Nov 10 16:42:30 user nova-compute[75102]:   <features>
Nov 10 16:42:30 user nova-compute[75102]:     <acpi/>
Nov 10 16:42:30 user nova-compute[75102]:     <apic/>
Nov 10 16:42:30 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:42:30 user nova-compute[75102]:   </features>
Nov 10 16:42:30 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:42:30 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:42:30 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:42:30 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:42:30 user nova-compute[75102]:   </clock>
Nov 10 16:42:30 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:42:30 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:42:30 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:42:30 user nova-compute[75102]:   </cpu>
Nov 10 16:42:30 user nova-compute[75102]:   <devices>
Nov 10 16:42:30 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:42:30 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:42:30 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk"/>
Nov 10 16:42:30 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:42:30 user nova-compute[75102]:     </disk>
Nov 10 16:42:30 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:42:30 user nova-compute[75102]:       <mac address="fa:16:3e:7c:ab:38"/>
Nov 10 16:42:30 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:42:30 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:42:30 user nova-compute[75102]:       <target dev="tapadd0526b-29"/>
Nov 10 16:42:30 user nova-compute[75102]:     </interface>
Nov 10 16:42:30 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:42:30 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/console.log" append="off"/>
Nov 10 16:42:30 user nova-compute[75102]:     </serial>
Nov 10 16:42:30 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:42:30 user nova-compute[75102]:     <video>
Nov 10 16:42:30 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:42:30 user nova-compute[75102]:     </video>
Nov 10 16:42:30 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:42:30 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:42:30 user nova-compute[75102]:     </rng>
Nov 10 16:42:30 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:42:30 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:42:30 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:42:30 user nova-compute[75102]:     </memballoon>
Nov 10 16:42:30 user nova-compute[75102]:   </devices>
Nov 10 16:42:30 user nova-compute[75102]: </domain>
Nov 10 16:42:30 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:42:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-193396418',display_name='tempest-VolumesSnapshotTestJSON-instance-193396418',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-193396418',id=42,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJNlyNeVGRaQw9uIZZS4SV76DhLgXDPGx7JBSwbY1ZKIZgWKQCgFaMb1wsI0L2V8pBMbiLA2kAtKamKexoaFrvjNnxI3WahLIV/V7ACUo/destg9Lh7BudK7MDiibeCdw==',key_name='tempest-keypair-402581287',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='09b9ad4975bb43fdbb94dd2742b3d590',ramdisk_id='',reservation_id='r-9o0hp8jg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-803710656',owner_user_name='tempest-VolumesSnapshotTestJSON-803710656-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:42:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78829a85087437da8edf53a02ae7358',uuid=34956fa9-e329-4681-8e37-1bb18def29cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converting VIF {"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ab:38,bridge_name='br-int',has_traffic_filtering=True,id=add0526b-29b8-4df4-b358-c5e79142a734,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd0526b-29') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG os_vif [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ab:38,bridge_name='br-int',has_traffic_filtering=True,id=add0526b-29b8-4df4-b358-c5e79142a734,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd0526b-29') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f326e228-1d71-5895-a8d0-0b2cc6b75663', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapadd0526b-29, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapadd0526b-29, col_values=(('qos', UUID('4e10d2d7-33b9-4249-8637-d359a0cad2c6')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapadd0526b-29, col_values=(('external_ids', {'iface-id': 'add0526b-29b8-4df4-b358-c5e79142a734', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7c:ab:38', 'vm-uuid': '34956fa9-e329-4681-8e37-1bb18def29cb'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:30 user nova-compute[75102]: INFO os_vif [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7c:ab:38,bridge_name='br-int',has_traffic_filtering=True,id=add0526b-29b8-4df4-b358-c5e79142a734,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd0526b-29')
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No VIF found with MAC fa:16:3e:7c:ab:38, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.neutron [req-20374ccd-f046-4ea8-94eb-2777b3c171c0 req-b1f1be5c-bce6-457e-bc74-e431eff06753 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Updated VIF entry in instance network info cache for port add0526b-29b8-4df4-b358-c5e79142a734. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG nova.network.neutron [req-20374ccd-f046-4ea8-94eb-2777b3c171c0 req-b1f1be5c-bce6-457e-bc74-e431eff06753 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Updating instance_info_cache with network_info: [{"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:42:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-20374ccd-f046-4ea8-94eb-2777b3c171c0 req-b1f1be5c-bce6-457e-bc74-e431eff06753 service nova] Releasing lock "refresh_cache-34956fa9-e329-4681-8e37-1bb18def29cb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-2c6db32d-e9bb-4d7b-a498-18cb71f367be req-986b5e52-26b8-4234-9a77-5e6f3c4a13a6 service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received event network-changed-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-2c6db32d-e9bb-4d7b-a498-18cb71f367be req-986b5e52-26b8-4234-9a77-5e6f3c4a13a6 service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Refreshing instance network info cache due to event network-changed-eddf99a6-0587-4544-8b2d-8e89fd431141. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2c6db32d-e9bb-4d7b-a498-18cb71f367be req-986b5e52-26b8-4234-9a77-5e6f3c4a13a6 service nova] Acquiring lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2c6db32d-e9bb-4d7b-a498-18cb71f367be req-986b5e52-26b8-4234-9a77-5e6f3c4a13a6 service nova] Acquired lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG nova.network.neutron [req-2c6db32d-e9bb-4d7b-a498-18cb71f367be req-986b5e52-26b8-4234-9a77-5e6f3c4a13a6 service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Refreshing network info cache for port eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:31 user nova-compute[75102]: INFO nova.compute.manager [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Terminating instance
Nov 10 16:42:31 user nova-compute[75102]: DEBUG nova.compute.manager [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-732a020f-b974-4f0c-96fb-ceeebd6abe9b req-ed88e707-4c2e-4906-aaa1-f25c84bc2f8c service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received event network-vif-unplugged-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-732a020f-b974-4f0c-96fb-ceeebd6abe9b req-ed88e707-4c2e-4906-aaa1-f25c84bc2f8c service nova] Acquiring lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-732a020f-b974-4f0c-96fb-ceeebd6abe9b req-ed88e707-4c2e-4906-aaa1-f25c84bc2f8c service nova] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-732a020f-b974-4f0c-96fb-ceeebd6abe9b req-ed88e707-4c2e-4906-aaa1-f25c84bc2f8c service nova] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-732a020f-b974-4f0c-96fb-ceeebd6abe9b req-ed88e707-4c2e-4906-aaa1-f25c84bc2f8c service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] No waiting events found dispatching network-vif-unplugged-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:42:31 user nova-compute[75102]: DEBUG nova.compute.manager [req-732a020f-b974-4f0c-96fb-ceeebd6abe9b req-ed88e707-4c2e-4906-aaa1-f25c84bc2f8c service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received event network-vif-unplugged-eddf99a6-0587-4544-8b2d-8e89fd431141 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.network.neutron [req-2c6db32d-e9bb-4d7b-a498-18cb71f367be req-986b5e52-26b8-4234-9a77-5e6f3c4a13a6 service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Updated VIF entry in instance network info cache for port eddf99a6-0587-4544-8b2d-8e89fd431141. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.network.neutron [req-2c6db32d-e9bb-4d7b-a498-18cb71f367be req-986b5e52-26b8-4234-9a77-5e6f3c4a13a6 service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Updating instance_info_cache with network_info: [{"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2c6db32d-e9bb-4d7b-a498-18cb71f367be req-986b5e52-26b8-4234-9a77-5e6f3c4a13a6 service nova] Releasing lock "refresh_cache-3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-47cf5d84-d3be-4ca9-8857-589c7b6cacb9 req-d2a7c6e2-14a1-461a-b336-9c50f7d4ca6c service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Received event network-vif-plugged-add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-47cf5d84-d3be-4ca9-8857-589c7b6cacb9 req-d2a7c6e2-14a1-461a-b336-9c50f7d4ca6c service nova] Acquiring lock "34956fa9-e329-4681-8e37-1bb18def29cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-47cf5d84-d3be-4ca9-8857-589c7b6cacb9 req-d2a7c6e2-14a1-461a-b336-9c50f7d4ca6c service nova] Lock "34956fa9-e329-4681-8e37-1bb18def29cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-47cf5d84-d3be-4ca9-8857-589c7b6cacb9 req-d2a7c6e2-14a1-461a-b336-9c50f7d4ca6c service nova] Lock "34956fa9-e329-4681-8e37-1bb18def29cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.compute.manager [req-47cf5d84-d3be-4ca9-8857-589c7b6cacb9 req-d2a7c6e2-14a1-461a-b336-9c50f7d4ca6c service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] No waiting events found dispatching network-vif-plugged-add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:42:32 user nova-compute[75102]: WARNING nova.compute.manager [req-47cf5d84-d3be-4ca9-8857-589c7b6cacb9 req-d2a7c6e2-14a1-461a-b336-9c50f7d4ca6c service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Received unexpected event network-vif-plugged-add0526b-29b8-4df4-b358-c5e79142a734 for instance with vm_state building and task_state spawning.
Nov 10 16:42:32 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Instance destroyed successfully.
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.objects.instance [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lazy-loading 'resources' on Instance uuid 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-295575412',display_name='tempest-TestStampPattern-server-295575412',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-295575412',id=36,image_ref='ef83d8d6-6b98-433a-a631-802b6ceebc2e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ8+LDBaM3IFKtZWt/WbN0wsXWTN3yBtKNBzWRh29A/ZPbyZyZTEWW+5+UGKfbdFjdDFqTq7gGbWdQpAbPZvSUbk8/mRUGgNL2pcc13I3ZIpl4yxUxyJFPJSb5GfPis2w==',key_name='tempest-TestStampPattern-81644141',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:37:30Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6dc60461b8e4239934a4dbba48519a7',ramdisk_id='',reservation_id='r-60u47u01',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='c9348a9d-5891-40f6-96c7-e8c7179cf315',image_min_disk='1',image_min_ram='0',image_owner_id='b6dc60461b8e4239934a4dbba48519a7',image_owner_project_name='tempest-TestStampPattern-314715126',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-314715126-project-member',image_user_id='6794c1f412bb4fe1a9199c54acaf0f69',owner_project_name='tempest-TestStampPattern-314715126',owner_user_name='tempest-TestStampPattern-314715126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:37:30Z,user_data=None,user_id='6794c1f412bb4fe1a9199c54acaf0f69',uuid=3912f3a0-2c22-44cc-84c6-85b2c5d49ad9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converting VIF {"id": "eddf99a6-0587-4544-8b2d-8e89fd431141", "address": "fa:16:3e:dd:08:76", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.64", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeddf99a6-05", "ovs_interfaceid": "eddf99a6-0587-4544-8b2d-8e89fd431141", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:dd:08:76,bridge_name='br-int',has_traffic_filtering=True,id=eddf99a6-0587-4544-8b2d-8e89fd431141,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeddf99a6-05') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG os_vif [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:08:76,bridge_name='br-int',has_traffic_filtering=True,id=eddf99a6-0587-4544-8b2d-8e89fd431141,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeddf99a6-05') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeddf99a6-05, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b21f41b3-9760-44e3-859e-1fd2fd757583) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:42:32 user nova-compute[75102]: INFO os_vif [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:dd:08:76,bridge_name='br-int',has_traffic_filtering=True,id=eddf99a6-0587-4544-8b2d-8e89fd431141,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeddf99a6-05')
Nov 10 16:42:32 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Deleting instance files /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9_del
Nov 10 16:42:32 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Deletion of /opt/stack/data/nova/instances/3912f3a0-2c22-44cc-84c6-85b2c5d49ad9_del complete
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:32 user nova-compute[75102]: INFO nova.compute.manager [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Took 1.06 seconds to destroy the instance on the hypervisor.
Nov 10 16:42:32 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:42:32 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:42:33 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Took 0.39 seconds to deallocate network for instance.
Nov 10 16:42:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.289s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:33 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Deleted allocations for instance 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9
Nov 10 16:42:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-49273d51-df36-4d3b-9c16-b15dc44f2df3 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.929s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-efcc6741-149b-4e88-bc50-35b72e14046c req-3eeb97bb-693a-402f-964d-c3734dc6db9f service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received event network-vif-plugged-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-efcc6741-149b-4e88-bc50-35b72e14046c req-3eeb97bb-693a-402f-964d-c3734dc6db9f service nova] Acquiring lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-efcc6741-149b-4e88-bc50-35b72e14046c req-3eeb97bb-693a-402f-964d-c3734dc6db9f service nova] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-efcc6741-149b-4e88-bc50-35b72e14046c req-3eeb97bb-693a-402f-964d-c3734dc6db9f service nova] Lock "3912f3a0-2c22-44cc-84c6-85b2c5d49ad9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:33 user nova-compute[75102]: DEBUG nova.compute.manager [req-efcc6741-149b-4e88-bc50-35b72e14046c req-3eeb97bb-693a-402f-964d-c3734dc6db9f service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] No waiting events found dispatching network-vif-plugged-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:42:33 user nova-compute[75102]: WARNING nova.compute.manager [req-efcc6741-149b-4e88-bc50-35b72e14046c req-3eeb97bb-693a-402f-964d-c3734dc6db9f service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received unexpected event network-vif-plugged-eddf99a6-0587-4544-8b2d-8e89fd431141 for instance with vm_state deleted and task_state None.
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-0a998481-c340-4660-9451-c44e3fb9e9c7 req-960710cf-8206-4c1f-a014-1360d720fdab service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Received event network-vif-plugged-add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0a998481-c340-4660-9451-c44e3fb9e9c7 req-960710cf-8206-4c1f-a014-1360d720fdab service nova] Acquiring lock "34956fa9-e329-4681-8e37-1bb18def29cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0a998481-c340-4660-9451-c44e3fb9e9c7 req-960710cf-8206-4c1f-a014-1360d720fdab service nova] Lock "34956fa9-e329-4681-8e37-1bb18def29cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0a998481-c340-4660-9451-c44e3fb9e9c7 req-960710cf-8206-4c1f-a014-1360d720fdab service nova] Lock "34956fa9-e329-4681-8e37-1bb18def29cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-0a998481-c340-4660-9451-c44e3fb9e9c7 req-960710cf-8206-4c1f-a014-1360d720fdab service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] No waiting events found dispatching network-vif-plugged-add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:42:34 user nova-compute[75102]: WARNING nova.compute.manager [req-0a998481-c340-4660-9451-c44e3fb9e9c7 req-960710cf-8206-4c1f-a014-1360d720fdab service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Received unexpected event network-vif-plugged-add0526b-29b8-4df4-b358-c5e79142a734 for instance with vm_state building and task_state spawning.
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.compute.manager [req-0a998481-c340-4660-9451-c44e3fb9e9c7 req-960710cf-8206-4c1f-a014-1360d720fdab service nova] [instance: 3912f3a0-2c22-44cc-84c6-85b2c5d49ad9] Received event network-vif-deleted-eddf99a6-0587-4544-8b2d-8e89fd431141 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:42:34 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Instance spawned successfully.
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:42:34 user nova-compute[75102]: INFO nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Took 5.97 seconds to spawn the instance on the hypervisor.
Nov 10 16:42:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:42:34 user nova-compute[75102]: INFO nova.compute.manager [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Took 6.80 seconds to build instance.
Nov 10 16:42:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ac930a2c-b837-4d19-b2af-20338326b82f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.902s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:42:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:42:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:42:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:42:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:42:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:51 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:42:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:42:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:01 user nova-compute[75102]: DEBUG nova.compute.manager [req-3bc55c2a-946b-4e14-8337-a5ddb341c4a0 req-fbbef05f-1fb4-4a57-8fa1-19d2cb276927 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received event network-changed-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:01 user nova-compute[75102]: DEBUG nova.compute.manager [req-3bc55c2a-946b-4e14-8337-a5ddb341c4a0 req-fbbef05f-1fb4-4a57-8fa1-19d2cb276927 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Refreshing instance network info cache due to event network-changed-9228e58f-cb9e-4beb-83e3-c1e8460afb0c. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:43:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3bc55c2a-946b-4e14-8337-a5ddb341c4a0 req-fbbef05f-1fb4-4a57-8fa1-19d2cb276927 service nova] Acquiring lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:43:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3bc55c2a-946b-4e14-8337-a5ddb341c4a0 req-fbbef05f-1fb4-4a57-8fa1-19d2cb276927 service nova] Acquired lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:43:01 user nova-compute[75102]: DEBUG nova.network.neutron [req-3bc55c2a-946b-4e14-8337-a5ddb341c4a0 req-fbbef05f-1fb4-4a57-8fa1-19d2cb276927 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Refreshing network info cache for port 9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:43:02 user nova-compute[75102]: DEBUG nova.network.neutron [req-3bc55c2a-946b-4e14-8337-a5ddb341c4a0 req-fbbef05f-1fb4-4a57-8fa1-19d2cb276927 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Updated VIF entry in instance network info cache for port 9228e58f-cb9e-4beb-83e3-c1e8460afb0c. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:43:02 user nova-compute[75102]: DEBUG nova.network.neutron [req-3bc55c2a-946b-4e14-8337-a5ddb341c4a0 req-fbbef05f-1fb4-4a57-8fa1-19d2cb276927 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Updating instance_info_cache with network_info: [{"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3bc55c2a-946b-4e14-8337-a5ddb341c4a0 req-fbbef05f-1fb4-4a57-8fa1-19d2cb276927 service nova] Releasing lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:43:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:03 user nova-compute[75102]: INFO nova.compute.manager [None req-a0fe0126-7591-4b4f-b089-1bf8e4cabee5 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Get console output
Nov 10 16:43:03 user nova-compute[75102]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 10 16:43:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:05 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:43:08 user nova-compute[75102]: INFO nova.compute.claims [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Claim successful on node user
Nov 10 16:43:08 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.359s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:43:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:43:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG nova.policy [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '50787ee821e0400eb445fe8cd891e119', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b656df48b2114d27a9bf9fe6df81037f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:43:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Creating image(s)
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.202s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.195s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk 1073741824" returned: 0 in 0.054s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG nova.network.neutron [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Successfully created port: 2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:43:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Cannot resize image /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Ensure instance console log exists: /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Successfully updated port: 2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquired lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-bcc9a246-d597-43b7-8b72-2f8718bc616c req-a2e18052-71ad-47b8-98b4-c181a2acc77d service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-changed-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-bcc9a246-d597-43b7-8b72-2f8718bc616c req-a2e18052-71ad-47b8-98b4-c181a2acc77d service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Refreshing instance network info cache due to event network-changed-2a7fa843-15f0-4f13-b376-9a42119762a9. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bcc9a246-d597-43b7-8b72-2f8718bc616c req-a2e18052-71ad-47b8-98b4-c181a2acc77d service nova] Acquiring lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updating instance_info_cache with network_info: [{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Releasing lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance network_info: |[{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bcc9a246-d597-43b7-8b72-2f8718bc616c req-a2e18052-71ad-47b8-98b4-c181a2acc77d service nova] Acquired lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-bcc9a246-d597-43b7-8b72-2f8718bc616c req-a2e18052-71ad-47b8-98b4-c181a2acc77d service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Refreshing network info cache for port 2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Start _get_guest_xml network_info=[{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:43:11 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:43:11 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-800447560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-800447560',id=43,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9Iv2sEN9Z9IGQzI64NWZQAK+DCOamr6sw77MfIYQMebL7N/P15VDSV+5my1oNSWIcEk5NzDjBDOfc1jZR9RFaplw1rxj8gr3GUDIh7PFk1HOk6texLXVK2iFgJK+pwjw==',key_name='tempest-keypair-287893862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b656df48b2114d27a9bf9fe6df81037f',ramdisk_id='',reservation_id='r-pejfuw9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1377452369',owner_user_name='tempest-AttachVolumeShelveTestJSON-1377452369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50787ee821e0400eb445fe8cd891e119',uuid=8ca14a6f-0eb8-42e4-a062-ea94d3e771e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converting VIF {"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.objects.instance [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:43:11 user nova-compute[75102]:   <uuid>8ca14a6f-0eb8-42e4-a062-ea94d3e771e5</uuid>
Nov 10 16:43:11 user nova-compute[75102]:   <name>instance-0000002b</name>
Nov 10 16:43:11 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:43:11 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:43:11 user nova-compute[75102]:   <metadata>
Nov 10 16:43:11 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:43:11 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:43:11 user nova-compute[75102]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-800447560</nova:name>
Nov 10 16:43:11 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:43:11</nova:creationTime>
Nov 10 16:43:11 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:43:11 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:43:11 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:43:11 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:43:11 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:43:11 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:43:11 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:43:11 user nova-compute[75102]:       <nova:owner>
Nov 10 16:43:11 user nova-compute[75102]:         <nova:user uuid="50787ee821e0400eb445fe8cd891e119">tempest-AttachVolumeShelveTestJSON-1377452369-project-member</nova:user>
Nov 10 16:43:11 user nova-compute[75102]:         <nova:project uuid="b656df48b2114d27a9bf9fe6df81037f">tempest-AttachVolumeShelveTestJSON-1377452369</nova:project>
Nov 10 16:43:11 user nova-compute[75102]:       </nova:owner>
Nov 10 16:43:11 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:43:11 user nova-compute[75102]:       <nova:ports>
Nov 10 16:43:11 user nova-compute[75102]:         <nova:port uuid="2a7fa843-15f0-4f13-b376-9a42119762a9">
Nov 10 16:43:11 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 16:43:11 user nova-compute[75102]:         </nova:port>
Nov 10 16:43:11 user nova-compute[75102]:       </nova:ports>
Nov 10 16:43:11 user nova-compute[75102]:     </nova:instance>
Nov 10 16:43:11 user nova-compute[75102]:   </metadata>
Nov 10 16:43:11 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:43:11 user nova-compute[75102]:     <system>
Nov 10 16:43:11 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:43:11 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:43:11 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:43:11 user nova-compute[75102]:       <entry name="serial">8ca14a6f-0eb8-42e4-a062-ea94d3e771e5</entry>
Nov 10 16:43:11 user nova-compute[75102]:       <entry name="uuid">8ca14a6f-0eb8-42e4-a062-ea94d3e771e5</entry>
Nov 10 16:43:11 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:43:11 user nova-compute[75102]:     </system>
Nov 10 16:43:11 user nova-compute[75102]:   </sysinfo>
Nov 10 16:43:11 user nova-compute[75102]:   <os>
Nov 10 16:43:11 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:43:11 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:43:11 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:43:11 user nova-compute[75102]:   </os>
Nov 10 16:43:11 user nova-compute[75102]:   <features>
Nov 10 16:43:11 user nova-compute[75102]:     <acpi/>
Nov 10 16:43:11 user nova-compute[75102]:     <apic/>
Nov 10 16:43:11 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:43:11 user nova-compute[75102]:   </features>
Nov 10 16:43:11 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:43:11 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:43:11 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:43:11 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:43:11 user nova-compute[75102]:   </clock>
Nov 10 16:43:11 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:43:11 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:43:11 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:43:11 user nova-compute[75102]:   </cpu>
Nov 10 16:43:11 user nova-compute[75102]:   <devices>
Nov 10 16:43:11 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:43:11 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:43:11 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk"/>
Nov 10 16:43:11 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:43:11 user nova-compute[75102]:     </disk>
Nov 10 16:43:11 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:43:11 user nova-compute[75102]:       <mac address="fa:16:3e:da:ba:32"/>
Nov 10 16:43:11 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:43:11 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:43:11 user nova-compute[75102]:       <target dev="tap2a7fa843-15"/>
Nov 10 16:43:11 user nova-compute[75102]:     </interface>
Nov 10 16:43:11 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:43:11 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/console.log" append="off"/>
Nov 10 16:43:11 user nova-compute[75102]:     </serial>
Nov 10 16:43:11 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:43:11 user nova-compute[75102]:     <video>
Nov 10 16:43:11 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:43:11 user nova-compute[75102]:     </video>
Nov 10 16:43:11 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:43:11 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:43:11 user nova-compute[75102]:     </rng>
Nov 10 16:43:11 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:43:11 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:43:11 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:43:11 user nova-compute[75102]:     </memballoon>
Nov 10 16:43:11 user nova-compute[75102]:   </devices>
Nov 10 16:43:11 user nova-compute[75102]: </domain>
Nov 10 16:43:11 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-800447560',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-800447560',id=43,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9Iv2sEN9Z9IGQzI64NWZQAK+DCOamr6sw77MfIYQMebL7N/P15VDSV+5my1oNSWIcEk5NzDjBDOfc1jZR9RFaplw1rxj8gr3GUDIh7PFk1HOk6texLXVK2iFgJK+pwjw==',key_name='tempest-keypair-287893862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b656df48b2114d27a9bf9fe6df81037f',ramdisk_id='',reservation_id='r-pejfuw9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1377452369',owner_user_name='tempest-AttachVolumeShelveTestJSON-1377452369-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:43:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50787ee821e0400eb445fe8cd891e119',uuid=8ca14a6f-0eb8-42e4-a062-ea94d3e771e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converting VIF {"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG os_vif [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25c1557a-c606-5e1f-ab81-3d12d1f03bbf', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a7fa843-15, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a7fa843-15, col_values=(('qos', UUID('3a140ad6-5ecf-42ec-8a52-7675ad097371')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a7fa843-15, col_values=(('external_ids', {'iface-id': '2a7fa843-15f0-4f13-b376-9a42119762a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:ba:32', 'vm-uuid': '8ca14a6f-0eb8-42e4-a062-ea94d3e771e5'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:11 user nova-compute[75102]: INFO os_vif [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15')
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] No VIF found with MAC fa:16:3e:da:ba:32, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-bcc9a246-d597-43b7-8b72-2f8718bc616c req-a2e18052-71ad-47b8-98b4-c181a2acc77d service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updated VIF entry in instance network info cache for port 2a7fa843-15f0-4f13-b376-9a42119762a9. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-bcc9a246-d597-43b7-8b72-2f8718bc616c req-a2e18052-71ad-47b8-98b4-c181a2acc77d service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updating instance_info_cache with network_info: [{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bcc9a246-d597-43b7-8b72-2f8718bc616c req-a2e18052-71ad-47b8-98b4-c181a2acc77d service nova] Releasing lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-2323f62c-85c0-4c99-9cf3-608dd4d7463e req-ab3e528e-2314-4904-9d14-4c71349e59af service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2323f62c-85c0-4c99-9cf3-608dd4d7463e req-ab3e528e-2314-4904-9d14-4c71349e59af service nova] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2323f62c-85c0-4c99-9cf3-608dd4d7463e req-ab3e528e-2314-4904-9d14-4c71349e59af service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2323f62c-85c0-4c99-9cf3-608dd4d7463e req-ab3e528e-2314-4904-9d14-4c71349e59af service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-2323f62c-85c0-4c99-9cf3-608dd4d7463e req-ab3e528e-2314-4904-9d14-4c71349e59af service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] No waiting events found dispatching network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:43:15 user nova-compute[75102]: WARNING nova.compute.manager [req-2323f62c-85c0-4c99-9cf3-608dd4d7463e req-ab3e528e-2314-4904-9d14-4c71349e59af service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received unexpected event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 for instance with vm_state building and task_state spawning.
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-0c59be53-c8c6-4e5a-969b-3a2a5b76947c req-9201a054-9b7f-41d9-89de-fd65a366edc1 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0c59be53-c8c6-4e5a-969b-3a2a5b76947c req-9201a054-9b7f-41d9-89de-fd65a366edc1 service nova] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0c59be53-c8c6-4e5a-969b-3a2a5b76947c req-9201a054-9b7f-41d9-89de-fd65a366edc1 service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0c59be53-c8c6-4e5a-969b-3a2a5b76947c req-9201a054-9b7f-41d9-89de-fd65a366edc1 service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-0c59be53-c8c6-4e5a-969b-3a2a5b76947c req-9201a054-9b7f-41d9-89de-fd65a366edc1 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] No waiting events found dispatching network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:43:15 user nova-compute[75102]: WARNING nova.compute.manager [req-0c59be53-c8c6-4e5a-969b-3a2a5b76947c req-9201a054-9b7f-41d9-89de-fd65a366edc1 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received unexpected event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 for instance with vm_state building and task_state spawning.
Nov 10 16:43:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance spawned successfully.
Nov 10 16:43:15 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:43:15 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8078MB free_disk=25.076377868652344GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9348a9d-5891-40f6-96c7-e8c7179cf315 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance da5d6c88-342c-423d-b0f4-5a18774e91f4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 2237c70c-96db-4b53-98a4-24ae8d0c3abe actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 34956fa9-e329-4681-8e37-1bb18def29cb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:43:15 user nova-compute[75102]: INFO nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Took 6.35 seconds to spawn the instance on the hypervisor.
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:43:15 user nova-compute[75102]: INFO nova.compute.manager [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Took 7.10 seconds to build instance.
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-166a2904-3dc9-47aa-962e-132b4d48708a tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.212s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:43:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updating instance_info_cache with network_info: [{"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "5e35afc7-c420-46ce-850e-8dc229283819" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "5e35afc7-c420-46ce-850e-8dc229283819" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:43:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:18 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:43:18 user nova-compute[75102]: INFO nova.compute.claims [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Claim successful on node user
Nov 10 16:43:18 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:43:18 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:43:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:43:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:43:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:43:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:43:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:43:18 user nova-compute[75102]: INFO nova.virt.block_device [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Booting with volume snapshot 4ece32d5-1ca0-4d82-a285-97ca578ffde9 at /dev/vda
Nov 10 16:43:18 user nova-compute[75102]: DEBUG nova.policy [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96544e5daa74d51a232f565129b328a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3cd7409a94429d9262ef8a2a664d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:43:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Successfully created port: 3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Successfully updated port: 3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "refresh_cache-5e35afc7-c420-46ce-850e-8dc229283819" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquired lock "refresh_cache-5e35afc7-c420-46ce-850e-8dc229283819" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-d7c71845-d9fc-4fa2-87a1-7bec98feae54 req-90c3315d-fd97-46ec-8068-d82c0117a030 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received event network-changed-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-d7c71845-d9fc-4fa2-87a1-7bec98feae54 req-90c3315d-fd97-46ec-8068-d82c0117a030 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Refreshing instance network info cache due to event network-changed-3ed3c810-8477-42f8-bd83-91a61098aa01. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d7c71845-d9fc-4fa2-87a1-7bec98feae54 req-90c3315d-fd97-46ec-8068-d82c0117a030 service nova] Acquiring lock "refresh_cache-5e35afc7-c420-46ce-850e-8dc229283819" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Updating instance_info_cache with network_info: [{"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Releasing lock "refresh_cache-5e35afc7-c420-46ce-850e-8dc229283819" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Instance network_info: |[{"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d7c71845-d9fc-4fa2-87a1-7bec98feae54 req-90c3315d-fd97-46ec-8068-d82c0117a030 service nova] Acquired lock "refresh_cache-5e35afc7-c420-46ce-850e-8dc229283819" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-d7c71845-d9fc-4fa2-87a1-7bec98feae54 req-90c3315d-fd97-46ec-8068-d82c0117a030 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Refreshing network info cache for port 3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-d7c71845-d9fc-4fa2-87a1-7bec98feae54 req-90c3315d-fd97-46ec-8068-d82c0117a030 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Updated VIF entry in instance network info cache for port 3ed3c810-8477-42f8-bd83-91a61098aa01. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-d7c71845-d9fc-4fa2-87a1-7bec98feae54 req-90c3315d-fd97-46ec-8068-d82c0117a030 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Updating instance_info_cache with network_info: [{"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d7c71845-d9fc-4fa2-87a1-7bec98feae54 req-90c3315d-fd97-46ec-8068-d82c0117a030 service nova] Releasing lock "refresh_cache-5e35afc7-c420-46ce-850e-8dc229283819" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:43:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:43:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:43:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:43:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:43:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:43:28 user nova-compute[75102]: WARNING nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] While synchronizing instance power states, found 7 instances in the database and 6 instances on the hypervisor.
Nov 10 16:43:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid c9348a9d-5891-40f6-96c7-e8c7179cf315 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid da5d6c88-342c-423d-b0f4-5a18774e91f4 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 2237c70c-96db-4b53-98a4-24ae8d0c3abe {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 34956fa9-e329-4681-8e37-1bb18def29cb {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 5e35afc7-c420-46ce-850e-8dc229283819 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "34956fa9-e329-4681-8e37-1bb18def29cb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "5e35afc7-c420-46ce-850e-8dc229283819" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.032s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.045s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.064s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.065s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:29 user nova-compute[75102]: INFO nova.compute.manager [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Unshelving
Nov 10 16:43:29 user nova-compute[75102]: INFO nova.virt.block_device [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Booting with volume 3c728d84-7f73-45ab-9cd6-475ca4b19334 at /dev/vda
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.utils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7688ada0-3ea0-4601-ac0c-0bb8a65d9be6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[202a23a5-fdb9-432f-8476-9d29612f4015]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[950430e6-1dac-41a9-a502-336f6499fa6f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff153132-8322-4453-8544-2b44d43c742b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:43:29 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1719d2-8374-4fc9-9e89-cfdabf7b9fef]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.utils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] <== get_connector_properties: return (177ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating existing volume attachment record: 721223a7-cc62-4a4e-bef0-b26f7a4e51a3 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.utils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[af9ab21b-527f-4522-a6ea-bbc2cf2137d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c7fc59-2663-44a8-bdcc-97549ebbc070]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f7881cf-fe34-4058-b7e7-653518964117]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c819d52b-6295-4ade-aa54-86abb1ebb948]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:43:29 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:43:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aac0ed5-b55f-49e7-a7f6-fa7ce5306704]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG os_brick.utils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:43:29 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Updating existing volume attachment record: 83ade625-0f30-4f0d-bdc6-2fff39083e28 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:43:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG nova.compute.manager [req-3c474815-2306-4b73-9463-0952e2c6f4ec req-cddf781d-6396-4010-abbc-b3df5007e45a service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received event network-changed-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG nova.compute.manager [req-3c474815-2306-4b73-9463-0952e2c6f4ec req-cddf781d-6396-4010-abbc-b3df5007e45a service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Refreshing instance network info cache due to event network-changed-85633d7f-63c9-46e3-aedf-1d5252041c10. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3c474815-2306-4b73-9463-0952e2c6f4ec req-cddf781d-6396-4010-abbc-b3df5007e45a service nova] Acquiring lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3c474815-2306-4b73-9463-0952e2c6f4ec req-cddf781d-6396-4010-abbc-b3df5007e45a service nova] Acquired lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG nova.network.neutron [req-3c474815-2306-4b73-9463-0952e2c6f4ec req-cddf781d-6396-4010-abbc-b3df5007e45a service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Refreshing network info cache for port 85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:47 user nova-compute[75102]: INFO nova.compute.manager [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Terminating instance
Nov 10 16:43:47 user nova-compute[75102]: DEBUG nova.compute.manager [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.network.neutron [req-3c474815-2306-4b73-9463-0952e2c6f4ec req-cddf781d-6396-4010-abbc-b3df5007e45a service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updated VIF entry in instance network info cache for port 85633d7f-63c9-46e3-aedf-1d5252041c10. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.network.neutron [req-3c474815-2306-4b73-9463-0952e2c6f4ec req-cddf781d-6396-4010-abbc-b3df5007e45a service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updating instance_info_cache with network_info: [{"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3c474815-2306-4b73-9463-0952e2c6f4ec req-cddf781d-6396-4010-abbc-b3df5007e45a service nova] Releasing lock "refresh_cache-c9348a9d-5891-40f6-96c7-e8c7179cf315" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.compute.manager [req-dd916837-0b3e-4c73-bd8c-a51cb9c957f5 req-c4460486-6b1b-4b11-8e22-20f4030a2d36 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received event network-vif-unplugged-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dd916837-0b3e-4c73-bd8c-a51cb9c957f5 req-c4460486-6b1b-4b11-8e22-20f4030a2d36 service nova] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dd916837-0b3e-4c73-bd8c-a51cb9c957f5 req-c4460486-6b1b-4b11-8e22-20f4030a2d36 service nova] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-dd916837-0b3e-4c73-bd8c-a51cb9c957f5 req-c4460486-6b1b-4b11-8e22-20f4030a2d36 service nova] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.compute.manager [req-dd916837-0b3e-4c73-bd8c-a51cb9c957f5 req-c4460486-6b1b-4b11-8e22-20f4030a2d36 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] No waiting events found dispatching network-vif-unplugged-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.compute.manager [req-dd916837-0b3e-4c73-bd8c-a51cb9c957f5 req-c4460486-6b1b-4b11-8e22-20f4030a2d36 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received event network-vif-unplugged-85633d7f-63c9-46e3-aedf-1d5252041c10 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:43:48 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Instance destroyed successfully.
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.objects.instance [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lazy-loading 'resources' on Instance uuid c9348a9d-5891-40f6-96c7-e8c7179cf315 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:33:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1070046215',display_name='tempest-TestStampPattern-server-1070046215',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1070046215',id=33,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCJ8+LDBaM3IFKtZWt/WbN0wsXWTN3yBtKNBzWRh29A/ZPbyZyZTEWW+5+UGKfbdFjdDFqTq7gGbWdQpAbPZvSUbk8/mRUGgNL2pcc13I3ZIpl4yxUxyJFPJSb5GfPis2w==',key_name='tempest-TestStampPattern-81644141',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:33:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6dc60461b8e4239934a4dbba48519a7',ramdisk_id='',reservation_id='r-713kxs3o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-314715126',owner_user_name='tempest-TestStampPattern-314715126-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:37:19Z,user_data=None,user_id='6794c1f412bb4fe1a9199c54acaf0f69',uuid=c9348a9d-5891-40f6-96c7-e8c7179cf315,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converting VIF {"id": "85633d7f-63c9-46e3-aedf-1d5252041c10", "address": "fa:16:3e:9e:78:6b", "network": {"id": "381582cb-6235-4981-84d7-a2a31279d9eb", "bridge": "br-int", "label": "tempest-TestStampPattern-1143805105-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6dc60461b8e4239934a4dbba48519a7", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap85633d7f-63", "ovs_interfaceid": "85633d7f-63c9-46e3-aedf-1d5252041c10", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:78:6b,bridge_name='br-int',has_traffic_filtering=True,id=85633d7f-63c9-46e3-aedf-1d5252041c10,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85633d7f-63') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG os_vif [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:78:6b,bridge_name='br-int',has_traffic_filtering=True,id=85633d7f-63c9-46e3-aedf-1d5252041c10,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85633d7f-63') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85633d7f-63, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=10370d68-35d8-43e1-9df5-41069a3bf90c) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:43:48 user nova-compute[75102]: INFO os_vif [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:78:6b,bridge_name='br-int',has_traffic_filtering=True,id=85633d7f-63c9-46e3-aedf-1d5252041c10,network=Network(381582cb-6235-4981-84d7-a2a31279d9eb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85633d7f-63')
Nov 10 16:43:48 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Deleting instance files /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315_del
Nov 10 16:43:48 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Deletion of /opt/stack/data/nova/instances/c9348a9d-5891-40f6-96c7-e8c7179cf315_del complete
Nov 10 16:43:48 user nova-compute[75102]: INFO nova.compute.manager [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 16:43:48 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:43:48 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:43:49 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:49 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Took 0.38 seconds to deallocate network for instance.
Nov 10 16:43:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:49 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:43:49 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:43:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.310s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:49 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Deleted allocations for instance c9348a9d-5891-40f6-96c7-e8c7179cf315
Nov 10 16:43:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-48a56f6a-0f90-4816-9bfe-53b23e283ce7 tempest-TestStampPattern-314715126 tempest-TestStampPattern-314715126-project-member] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.774s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-743f1fae-1358-4ddd-8c72-a592bce6041e req-2ed4c793-53dc-422f-9dfc-78b883d77168 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received event network-vif-deleted-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-020c92bf-060c-4b01-b936-d39d0e806cb2 req-3ec19446-5a40-4cdc-b360-c40cb28cd805 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received event network-vif-plugged-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-020c92bf-060c-4b01-b936-d39d0e806cb2 req-3ec19446-5a40-4cdc-b360-c40cb28cd805 service nova] Acquiring lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-020c92bf-060c-4b01-b936-d39d0e806cb2 req-3ec19446-5a40-4cdc-b360-c40cb28cd805 service nova] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-020c92bf-060c-4b01-b936-d39d0e806cb2 req-3ec19446-5a40-4cdc-b360-c40cb28cd805 service nova] Lock "c9348a9d-5891-40f6-96c7-e8c7179cf315-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-020c92bf-060c-4b01-b936-d39d0e806cb2 req-3ec19446-5a40-4cdc-b360-c40cb28cd805 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] No waiting events found dispatching network-vif-plugged-85633d7f-63c9-46e3-aedf-1d5252041c10 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:43:50 user nova-compute[75102]: WARNING nova.compute.manager [req-020c92bf-060c-4b01-b936-d39d0e806cb2 req-3ec19446-5a40-4cdc-b360-c40cb28cd805 service nova] [instance: c9348a9d-5891-40f6-96c7-e8c7179cf315] Received unexpected event network-vif-plugged-85633d7f-63c9-46e3-aedf-1d5252041c10 for instance with vm_state deleted and task_state None.
Nov 10 16:43:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:43:55 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Creating image(s)
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Ensure instance console log exists: /opt/stack/data/nova/instances/5e35afc7-c420-46ce-850e-8dc229283819/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Start _get_guest_xml network_info=[{"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T16:43:03Z,direct_url=<?>,disk_format='qcow2',id=d8d1a951-b810-48fa-bac0-8f5c2918a571,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2052691645',owner='fe3cd7409a94429d9262ef8a2a664d7c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T16:43:05Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '83ade625-0f30-4f0d-bdc6-2fff39083e28', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfXznkvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5e35afc7-c420-46ce-850e-8dc229283819', 'attached_at': '', 'detached_at': '', 'volume_id': '55c21e96-4aec-4e65-b706-c92345f30052', 'serial': '55c21e96-4aec-4e65-b706-c92345f30052'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:43:55 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:43:55 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-10T16:43:03Z,direct_url=<?>,disk_format='qcow2',id=d8d1a951-b810-48fa-bac0-8f5c2918a571,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-2052691645',owner='fe3cd7409a94429d9262ef8a2a664d7c',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-10T16:43:05Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfXznkvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:43:55 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:43:55 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:43:55 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1756e344-4516-4a58-b052-75d1daa459d1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:43:55 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lazy-loading 'pci_requests' on Instance uuid b57fe73f-7ce0-4290-9f14-300de96d9e38 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ebc0e2-4ad2-4a0a-b3b7-be3e4873f86d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052] added
Nov 10 16:43:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lazy-loading 'numa_topology' on Instance uuid b57fe73f-7ce0-4290-9f14-300de96d9e38 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a58b29c-5b62-4500-a5a1-0680ceb13fe8]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:43:55 user nova-compute[75102]: INFO nova.compute.claims [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Claim successful on node user
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[662cabee-1249-41a2-83b7-c9d7789e6c8f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfXznkvQ {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IfXznkvQ" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a47045-a1b1-4600-b690-a5e3740bd5cc]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IfXznkvQ'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d739a8da-6fe3-444c-9ccf-d532dbd6f8bc]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6aac65-c3ce-4800-8ebe-59685f6b10b4]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0cdbc8-1394-42de-ae88-b30fbfaf73b6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052, portal: 172.16.0.220,3260]
Nov 10 16:43:55 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052, portal: 172.16.0.220,3260] successful.
Nov 10 16:43:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc6e478c-74b3-45d7-944a-a2ba235393af]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a91b87-9ec1-4a19-9f99-d568feef5f5e]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:43:55 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] HCTL ('35', '-', '-', 0) found on session 38 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0371a90-ff33-44f9-b80d-e2d98f1d5a4d]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching for a device in session 38 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfXznkvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:43:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.430s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:55 user nova-compute[75102]: INFO nova.network.neutron [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating port 41c704f1-d29a-491b-9f9f-d1d4e3badf13 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquired lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-c842a5f0-b2f4-4652-8d03-41ea72cddfaa req-e35a4678-078f-43cb-a02d-79467d2e0293 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.compute.manager [req-c842a5f0-b2f4-4652-8d03-41ea72cddfaa req-e35a4678-078f-43cb-a02d-79467d2e0293 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing instance network info cache due to event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c842a5f0-b2f4-4652-8d03-41ea72cddfaa req-e35a4678-078f-43cb-a02d-79467d2e0293 service nova] Acquiring lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '26163613935333438', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163613935333438', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1621605347',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1621605347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1621605347',id=44,image_ref='d8d1a951-b810-48fa-bac0-8f5c2918a571',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhyZ87xTycLKizyF8nUpeVCRetb1+Yjcmp3bAA2WIW8e/rn8sbYQFY/SCi/lI+R70tEzIdIKS2bvvoVzC2AqnhpAd4LRwQwaiWujUbN4I4gObszZQ+JTkYP4dze9/xDiA==',key_name='tempest-keypair-338786039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-4xrj8emj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1535704831',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96544e5daa74d51a232f565129b328a',uuid=5e35afc7-c420-46ce-850e-8dc229283819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=3ed3c810-8477-42f8-bd83-91a61098aa01,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3c810-84') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'pci_devices' on Instance uuid 5e35afc7-c420-46ce-850e-8dc229283819 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:43:56 user nova-compute[75102]:   <uuid>5e35afc7-c420-46ce-850e-8dc229283819</uuid>
Nov 10 16:43:56 user nova-compute[75102]:   <name>instance-0000002c</name>
Nov 10 16:43:56 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:43:56 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:43:56 user nova-compute[75102]:   <metadata>
Nov 10 16:43:56 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:43:56 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:43:56 user nova-compute[75102]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1621605347</nova:name>
Nov 10 16:43:56 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:43:55</nova:creationTime>
Nov 10 16:43:56 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:43:56 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:43:56 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:43:56 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:43:56 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:43:56 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:43:56 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:43:56 user nova-compute[75102]:       <nova:owner>
Nov 10 16:43:56 user nova-compute[75102]:         <nova:user uuid="e96544e5daa74d51a232f565129b328a">tempest-TestVolumeBootPattern-1535704831-project-member</nova:user>
Nov 10 16:43:56 user nova-compute[75102]:         <nova:project uuid="fe3cd7409a94429d9262ef8a2a664d7c">tempest-TestVolumeBootPattern-1535704831</nova:project>
Nov 10 16:43:56 user nova-compute[75102]:       </nova:owner>
Nov 10 16:43:56 user nova-compute[75102]:       <nova:root type="image" uuid="d8d1a951-b810-48fa-bac0-8f5c2918a571"/>
Nov 10 16:43:56 user nova-compute[75102]:       <nova:ports>
Nov 10 16:43:56 user nova-compute[75102]:         <nova:port uuid="3ed3c810-8477-42f8-bd83-91a61098aa01">
Nov 10 16:43:56 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:43:56 user nova-compute[75102]:         </nova:port>
Nov 10 16:43:56 user nova-compute[75102]:       </nova:ports>
Nov 10 16:43:56 user nova-compute[75102]:     </nova:instance>
Nov 10 16:43:56 user nova-compute[75102]:   </metadata>
Nov 10 16:43:56 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:43:56 user nova-compute[75102]:     <system>
Nov 10 16:43:56 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:43:56 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:43:56 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:43:56 user nova-compute[75102]:       <entry name="serial">5e35afc7-c420-46ce-850e-8dc229283819</entry>
Nov 10 16:43:56 user nova-compute[75102]:       <entry name="uuid">5e35afc7-c420-46ce-850e-8dc229283819</entry>
Nov 10 16:43:56 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:43:56 user nova-compute[75102]:     </system>
Nov 10 16:43:56 user nova-compute[75102]:   </sysinfo>
Nov 10 16:43:56 user nova-compute[75102]:   <os>
Nov 10 16:43:56 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:43:56 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:43:56 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:43:56 user nova-compute[75102]:   </os>
Nov 10 16:43:56 user nova-compute[75102]:   <features>
Nov 10 16:43:56 user nova-compute[75102]:     <acpi/>
Nov 10 16:43:56 user nova-compute[75102]:     <apic/>
Nov 10 16:43:56 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:43:56 user nova-compute[75102]:   </features>
Nov 10 16:43:56 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:43:56 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:43:56 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:43:56 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:43:56 user nova-compute[75102]:   </clock>
Nov 10 16:43:56 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:43:56 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:43:56 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:43:56 user nova-compute[75102]:   </cpu>
Nov 10 16:43:56 user nova-compute[75102]:   <devices>
Nov 10 16:43:56 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:43:56 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:43:56 user nova-compute[75102]:       <source dev="/dev/sdd"/>
Nov 10 16:43:56 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:43:56 user nova-compute[75102]:       <serial>55c21e96-4aec-4e65-b706-c92345f30052</serial>
Nov 10 16:43:56 user nova-compute[75102]:     </disk>
Nov 10 16:43:56 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:43:56 user nova-compute[75102]:       <mac address="fa:16:3e:8a:fd:b8"/>
Nov 10 16:43:56 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:43:56 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:43:56 user nova-compute[75102]:       <target dev="tap3ed3c810-84"/>
Nov 10 16:43:56 user nova-compute[75102]:     </interface>
Nov 10 16:43:56 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:43:56 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/5e35afc7-c420-46ce-850e-8dc229283819/console.log" append="off"/>
Nov 10 16:43:56 user nova-compute[75102]:     </serial>
Nov 10 16:43:56 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:43:56 user nova-compute[75102]:     <video>
Nov 10 16:43:56 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:43:56 user nova-compute[75102]:     </video>
Nov 10 16:43:56 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:43:56 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:43:56 user nova-compute[75102]:     </rng>
Nov 10 16:43:56 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:43:56 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:43:56 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:43:56 user nova-compute[75102]:     </memballoon>
Nov 10 16:43:56 user nova-compute[75102]:   </devices>
Nov 10 16:43:56 user nova-compute[75102]: </domain>
Nov 10 16:43:56 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1621605347',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1621605347',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1621605347',id=44,image_ref='d8d1a951-b810-48fa-bac0-8f5c2918a571',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhyZ87xTycLKizyF8nUpeVCRetb1+Yjcmp3bAA2WIW8e/rn8sbYQFY/SCi/lI+R70tEzIdIKS2bvvoVzC2AqnhpAd4LRwQwaiWujUbN4I4gObszZQ+JTkYP4dze9/xDiA==',key_name='tempest-keypair-338786039',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-4xrj8emj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1535704831',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:43:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96544e5daa74d51a232f565129b328a',uuid=5e35afc7-c420-46ce-850e-8dc229283819,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=3ed3c810-8477-42f8-bd83-91a61098aa01,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3c810-84') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG os_vif [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=3ed3c810-8477-42f8-bd83-91a61098aa01,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3c810-84') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4e17db6b-5388-5acb-9393-b24a39c4fe27', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ed3c810-84, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3ed3c810-84, col_values=(('qos', UUID('87881ab5-5f71-40cb-b2f2-84f29a2f1c25')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3ed3c810-84, col_values=(('external_ids', {'iface-id': '3ed3c810-8477-42f8-bd83-91a61098aa01', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:fd:b8', 'vm-uuid': '5e35afc7-c420-46ce-850e-8dc229283819'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:56 user nova-compute[75102]: INFO os_vif [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=3ed3c810-8477-42f8-bd83-91a61098aa01,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3c810-84')
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No VIF found with MAC fa:16:3e:8a:fd:b8, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.network.neutron [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Releasing lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:43:56 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Creating image(s)
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Ensure instance console log exists: /opt/stack/data/nova/instances/b57fe73f-7ce0-4290-9f14-300de96d9e38/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Start _get_guest_xml network_info=[{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '721223a7-cc62-4a4e-bef0-b26f7a4e51a3', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmLjEcxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b57fe73f-7ce0-4290-9f14-300de96d9e38', 'attached_at': '', 'detached_at': '', 'volume_id': '3c728d84-7f73-45ab-9cd6-475ca4b19334', 'serial': '3c728d84-7f73-45ab-9cd6-475ca4b19334'}, 'delete_on_termination': True, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c842a5f0-b2f4-4652-8d03-41ea72cddfaa req-e35a4678-078f-43cb-a02d-79467d2e0293 service nova] Acquired lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.network.neutron [req-c842a5f0-b2f4-4652-8d03-41ea72cddfaa req-e35a4678-078f-43cb-a02d-79467d2e0293 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:43:56 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:43:56 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lazy-loading 'vcpu_model' on Instance uuid b57fe73f-7ce0-4290-9f14-300de96d9e38 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.objects.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Object Instance<b57fe73f-7ce0-4290-9f14-300de96d9e38> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmLjEcxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:43:56 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:43:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:43:56 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:43:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:43:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:43:56 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:43:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260" returned: 21 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f7e894-8609-4491-9b74-374028d166a6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:43:57 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8dab92-1e31-47b7-a14c-8fc3f1f8e851]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334] added
Nov 10 16:43:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b04dcc0-4065-4f24-a2fc-a2ccbbb13e14]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[990b485a-138e-4d8e-879b-35e0c6033d35]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmLjEcxl {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PmLjEcxl" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c57274aa-8521-49d6-8331-6b909e6d8ac0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PmLjEcxl'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a022186-33ba-4d84-b7f4-e9a676f2dea1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8a558e-44e4-4cc3-a2fa-0453e55e4d3d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[649ed337-36df-47c7-b5a0-74bd29676940]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260]
Nov 10 16:43:57 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260] successful.
Nov 10 16:43:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b83494b-9ca9-4153-aa82-d8994805cfd2]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[86b90c9d-6631-4e79-a08d-d1e4166d174d]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:43:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] HCTL ('36', '-', '-', 0) found on session 39 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d4bddd-7eed-4961-9d4a-811d04eba574]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG nova.network.neutron [req-c842a5f0-b2f4-4652-8d03-41ea72cddfaa req-e35a4678-078f-43cb-a02d-79467d2e0293 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updated VIF entry in instance network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG nova.network.neutron [req-c842a5f0-b2f4-4652-8d03-41ea72cddfaa req-e35a4678-078f-43cb-a02d-79467d2e0293 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:43:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c842a5f0-b2f4-4652-8d03-41ea72cddfaa req-e35a4678-078f-43cb-a02d-79467d2e0293 service nova] Releasing lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Searching for a device in session 39 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmLjEcxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.389s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] <== connect_volume: return (1391ms) {'type': 'block', 'scsi_wwn': '26661383731323464', 'path': '/dev/sde'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26661383731323464', 'path': '/dev/sde'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1971436327',display_name='tempest-TestShelveInstance-server-1971436327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1971436327',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1509801576',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b7089a983faf4dbebfc6f9514a154c83',ramdisk_id='',reservation_id='r-he2uv6iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-188193481',owner_user_name='tempest-TestShelveInstance-188193481-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:43:29Z,user_data=None,user_id='190f5287874a4a04a1436f7c6b5213d7',uuid=b57fe73f-7ce0-4290-9f14-300de96d9e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converting VIF {"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.objects.instance [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lazy-loading 'pci_devices' on Instance uuid b57fe73f-7ce0-4290-9f14-300de96d9e38 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.objects.base [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Object Instance<b57fe73f-7ce0-4290-9f14-300de96d9e38> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:43:58 user nova-compute[75102]:   <uuid>b57fe73f-7ce0-4290-9f14-300de96d9e38</uuid>
Nov 10 16:43:58 user nova-compute[75102]:   <name>instance-00000028</name>
Nov 10 16:43:58 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:43:58 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:43:58 user nova-compute[75102]:   <metadata>
Nov 10 16:43:58 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:43:58 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:43:58 user nova-compute[75102]:       <nova:name>tempest-TestShelveInstance-server-1971436327</nova:name>
Nov 10 16:43:58 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:43:56</nova:creationTime>
Nov 10 16:43:58 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:43:58 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:43:58 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:43:58 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:43:58 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:43:58 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:43:58 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:43:58 user nova-compute[75102]:       <nova:owner>
Nov 10 16:43:58 user nova-compute[75102]:         <nova:user uuid="190f5287874a4a04a1436f7c6b5213d7">tempest-TestShelveInstance-188193481-project-member</nova:user>
Nov 10 16:43:58 user nova-compute[75102]:         <nova:project uuid="b7089a983faf4dbebfc6f9514a154c83">tempest-TestShelveInstance-188193481</nova:project>
Nov 10 16:43:58 user nova-compute[75102]:       </nova:owner>
Nov 10 16:43:58 user nova-compute[75102]:       <nova:ports>
Nov 10 16:43:58 user nova-compute[75102]:         <nova:port uuid="41c704f1-d29a-491b-9f9f-d1d4e3badf13">
Nov 10 16:43:58 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 16:43:58 user nova-compute[75102]:         </nova:port>
Nov 10 16:43:58 user nova-compute[75102]:       </nova:ports>
Nov 10 16:43:58 user nova-compute[75102]:     </nova:instance>
Nov 10 16:43:58 user nova-compute[75102]:   </metadata>
Nov 10 16:43:58 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:43:58 user nova-compute[75102]:     <system>
Nov 10 16:43:58 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:43:58 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:43:58 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:43:58 user nova-compute[75102]:       <entry name="serial">b57fe73f-7ce0-4290-9f14-300de96d9e38</entry>
Nov 10 16:43:58 user nova-compute[75102]:       <entry name="uuid">b57fe73f-7ce0-4290-9f14-300de96d9e38</entry>
Nov 10 16:43:58 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:43:58 user nova-compute[75102]:     </system>
Nov 10 16:43:58 user nova-compute[75102]:   </sysinfo>
Nov 10 16:43:58 user nova-compute[75102]:   <os>
Nov 10 16:43:58 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:43:58 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:43:58 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:43:58 user nova-compute[75102]:   </os>
Nov 10 16:43:58 user nova-compute[75102]:   <features>
Nov 10 16:43:58 user nova-compute[75102]:     <acpi/>
Nov 10 16:43:58 user nova-compute[75102]:     <apic/>
Nov 10 16:43:58 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:43:58 user nova-compute[75102]:   </features>
Nov 10 16:43:58 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:43:58 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:43:58 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:43:58 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:43:58 user nova-compute[75102]:   </clock>
Nov 10 16:43:58 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:43:58 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:43:58 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:43:58 user nova-compute[75102]:   </cpu>
Nov 10 16:43:58 user nova-compute[75102]:   <devices>
Nov 10 16:43:58 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:43:58 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:43:58 user nova-compute[75102]:       <source dev="/dev/sde"/>
Nov 10 16:43:58 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:43:58 user nova-compute[75102]:       <serial>3c728d84-7f73-45ab-9cd6-475ca4b19334</serial>
Nov 10 16:43:58 user nova-compute[75102]:     </disk>
Nov 10 16:43:58 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:43:58 user nova-compute[75102]:       <mac address="fa:16:3e:67:34:f2"/>
Nov 10 16:43:58 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:43:58 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:43:58 user nova-compute[75102]:       <target dev="tap41c704f1-d2"/>
Nov 10 16:43:58 user nova-compute[75102]:     </interface>
Nov 10 16:43:58 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:43:58 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/b57fe73f-7ce0-4290-9f14-300de96d9e38/console.log" append="off"/>
Nov 10 16:43:58 user nova-compute[75102]:     </serial>
Nov 10 16:43:58 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:43:58 user nova-compute[75102]:     <video>
Nov 10 16:43:58 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:43:58 user nova-compute[75102]:     </video>
Nov 10 16:43:58 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:43:58 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:43:58 user nova-compute[75102]:     </rng>
Nov 10 16:43:58 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:43:58 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:43:58 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:43:58 user nova-compute[75102]:     </memballoon>
Nov 10 16:43:58 user nova-compute[75102]:   </devices>
Nov 10 16:43:58 user nova-compute[75102]: </domain>
Nov 10 16:43:58 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1971436327',display_name='tempest-TestShelveInstance-server-1971436327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1971436327',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1509801576',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:40:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b7089a983faf4dbebfc6f9514a154c83',ramdisk_id='',reservation_id='r-he2uv6iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-188193481',owner_user_name='tempest-TestShelveInstance-188193481-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:43:29Z,user_data=None,user_id='190f5287874a4a04a1436f7c6b5213d7',uuid=b57fe73f-7ce0-4290-9f14-300de96d9e38,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converting VIF {"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG os_vif [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2d16fe1-257d-5e77-8dc1-66e9acd080ac', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap41c704f1-d2, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap41c704f1-d2, col_values=(('qos', UUID('fd8a2b6e-cbfa-4a56-ab7c-de3d945231d6')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap41c704f1-d2, col_values=(('external_ids', {'iface-id': '41c704f1-d29a-491b-9f9f-d1d4e3badf13', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:67:34:f2', 'vm-uuid': 'b57fe73f-7ce0-4290-9f14-300de96d9e38'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: INFO os_vif [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2')
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] No VIF found with MAC fa:16:3e:67:34:f2, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-944c7996-38ab-4fb8-8a96-f1d453c39269 req-9b89254a-f13e-4ca7-881c-2862038e0910 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received event network-vif-plugged-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-944c7996-38ab-4fb8-8a96-f1d453c39269 req-9b89254a-f13e-4ca7-881c-2862038e0910 service nova] Acquiring lock "5e35afc7-c420-46ce-850e-8dc229283819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-944c7996-38ab-4fb8-8a96-f1d453c39269 req-9b89254a-f13e-4ca7-881c-2862038e0910 service nova] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-944c7996-38ab-4fb8-8a96-f1d453c39269 req-9b89254a-f13e-4ca7-881c-2862038e0910 service nova] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-944c7996-38ab-4fb8-8a96-f1d453c39269 req-9b89254a-f13e-4ca7-881c-2862038e0910 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] No waiting events found dispatching network-vif-plugged-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:43:58 user nova-compute[75102]: WARNING nova.compute.manager [req-944c7996-38ab-4fb8-8a96-f1d453c39269 req-9b89254a-f13e-4ca7-881c-2862038e0910 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received unexpected event network-vif-plugged-3ed3c810-8477-42f8-bd83-91a61098aa01 for instance with vm_state building and task_state spawning.
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:43:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received event network-vif-plugged-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] Acquiring lock "5e35afc7-c420-46ce-850e-8dc229283819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] No waiting events found dispatching network-vif-plugged-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:44:00 user nova-compute[75102]: WARNING nova.compute.manager [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received unexpected event network-vif-plugged-3ed3c810-8477-42f8-bd83-91a61098aa01 for instance with vm_state building and task_state spawning.
Nov 10 16:44:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] No waiting events found dispatching network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:44:00 user nova-compute[75102]: WARNING nova.compute.manager [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received unexpected event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 16:44:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] No waiting events found dispatching network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:44:00 user nova-compute[75102]: WARNING nova.compute.manager [req-91b9b25f-6c65-4154-9d43-8240949ff3a4 req-ac1539d9-8485-4a0e-9565-e58b075221b3 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received unexpected event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 16:44:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:44:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:44:01 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Instance spawned successfully.
Nov 10 16:44:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:44:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:44:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:44:01 user nova-compute[75102]: INFO nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Took 6.56 seconds to spawn the instance on the hypervisor.
Nov 10 16:44:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:44:01 user nova-compute[75102]: INFO nova.compute.manager [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Took 43.87 seconds to build instance.
Nov 10 16:44:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a609ae7b-790d-406d-b0c3-fc5486c45baf tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "5e35afc7-c420-46ce-850e-8dc229283819" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.979s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "5e35afc7-c420-46ce-850e-8dc229283819" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 33.381s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:01 user nova-compute[75102]: INFO nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] During sync_power_state the instance has a pending task (block_device_mapping). Skip.
Nov 10 16:44:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "5e35afc7-c420-46ce-850e-8dc229283819" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:44:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:44:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Instance spawned successfully.
Nov 10 16:44:02 user nova-compute[75102]: DEBUG nova.compute.manager [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:44:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-d47cb50f-9c6d-4d2f-bc29-60dc9cbe169d tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 33.346s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:04 user nova-compute[75102]: INFO nova.compute.manager [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Terminating instance
Nov 10 16:44:04 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-4cc5f376-1ed4-467b-bf96-6875ac298d8a req-1c0bdd3d-ed75-4250-a5f1-3b41d0380b0a service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-unplugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4cc5f376-1ed4-467b-bf96-6875ac298d8a req-1c0bdd3d-ed75-4250-a5f1-3b41d0380b0a service nova] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4cc5f376-1ed4-467b-bf96-6875ac298d8a req-1c0bdd3d-ed75-4250-a5f1-3b41d0380b0a service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4cc5f376-1ed4-467b-bf96-6875ac298d8a req-1c0bdd3d-ed75-4250-a5f1-3b41d0380b0a service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-4cc5f376-1ed4-467b-bf96-6875ac298d8a req-1c0bdd3d-ed75-4250-a5f1-3b41d0380b0a service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] No waiting events found dispatching network-vif-unplugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-4cc5f376-1ed4-467b-bf96-6875ac298d8a req-1c0bdd3d-ed75-4250-a5f1-3b41d0380b0a service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-unplugged-7530f992-ba56-418f-abbe-0e16fe005dfb for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:05 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Instance destroyed successfully.
Nov 10 16:44:05 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'resources' on Instance uuid da5d6c88-342c-423d-b0f4-5a18774e91f4 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:37:29Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1390976736',display_name='tempest-ServerActionsTestOtherA-server-1390976736',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1390976736',id=37,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJIyuW1YgII5m42ZzPQI/sKQHH3q65mUxP8WzQFSf/4n/JTQ1Wu3opROEkHOGysy1Wt2WY0dRoS8kKXFZZja/7C79VSuXQ0L9aJFgTEonW/PDJXKdDwWpg0JM1ZatQvbg==',key_name='tempest-keypair-394571970',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:39:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-s4xfkfdf',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:41:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=da5d6c88-342c-423d-b0f4-5a18774e91f4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "7530f992-ba56-418f-abbe-0e16fe005dfb", "address": "fa:16:3e:73:47:f7", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.87", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7530f992-ba", "ovs_interfaceid": "7530f992-ba56-418f-abbe-0e16fe005dfb", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_vif [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7530f992-ba, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0c55a12b-0c35-4258-b018-9ec413cd6af9) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:44:05 user nova-compute[75102]: INFO os_vif [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:47:f7,bridge_name='br-int',has_traffic_filtering=True,id=7530f992-ba56-418f-abbe-0e16fe005dfb,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7530f992-ba')
Nov 10 16:44:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'sYAhnOwR', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:44:05 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.038s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b559c45-cb10-4a1f-bf98-72ce72a319d7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:44:05 user nova-compute[75102]: No targets found.
Nov 10 16:44:05 user nova-compute[75102]: iSNS:
Nov 10 16:44:05 user nova-compute[75102]: No targets found.
Nov 10 16:44:05 user nova-compute[75102]: STATIC:
Nov 10 16:44:05 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052
Nov 10 16:44:05 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:44:05 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:44:05 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334
Nov 10 16:44:05 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:44:05 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:44:05 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35
Nov 10 16:44:05 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:44:05 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:44:05 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24
Nov 10 16:44:05 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:44:05 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:44:05 user nova-compute[75102]: FIRMWARE:
Nov 10 16:44:05 user nova-compute[75102]: No targets found.
Nov 10 16:44:05 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:44:05 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:44:05 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[28bb7ef6-e810-40c4-90e5-38bab7a6735e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd5ebc3-ee90-438d-91e4-825934eb550b]: (4, ('tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:44:05 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:44:05 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:44:05 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:44:05 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsi session list stdout=tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 (non-flash)
Nov 10 16:44:05 user nova-compute[75102]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:44:05 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:44:05 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:44:05 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f544bd3f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[26d858fe-58b1-441a-bd08-2e4383564ac7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d7eb95-2793-482a-9e1b-6c71a62cc4f4]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdf153f-cfaa-45ee-8842-2749ff0075a2]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.066s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf24edc3-5922-45bb-ade9-942391af4aea]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86876bc-c88c-4e2f-9bee-43f6b7738f7e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9efd1fd-5964-4e33-826c-c3e9e4121734]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260]
Nov 10 16:44:05 user nova-compute[75102]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24, portal: 172.16.0.220,3260] successful.
Nov 10 16:44:05 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb56dbd-15f1-42dd-adee-fa40ddef298b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.424s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] <== disconnect_volume: return (426ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:44:05 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Deleting instance files /opt/stack/data/nova/instances/da5d6c88-342c-423d-b0f4-5a18774e91f4_del
Nov 10 16:44:05 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Deletion of /opt/stack/data/nova/instances/da5d6c88-342c-423d-b0f4-5a18774e91f4_del complete
Nov 10 16:44:05 user nova-compute[75102]: INFO nova.compute.manager [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Took 1.50 seconds to destroy the instance on the hypervisor.
Nov 10 16:44:05 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:44:05 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:44:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-0c9b096c-aa50-4b57-a2f3-cb48ab0ad3ff req-c2fb4129-9274-4de4-a75b-809b8d6627ff service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:44:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0c9b096c-aa50-4b57-a2f3-cb48ab0ad3ff req-c2fb4129-9274-4de4-a75b-809b8d6627ff service nova] Acquiring lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0c9b096c-aa50-4b57-a2f3-cb48ab0ad3ff req-c2fb4129-9274-4de4-a75b-809b8d6627ff service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0c9b096c-aa50-4b57-a2f3-cb48ab0ad3ff req-c2fb4129-9274-4de4-a75b-809b8d6627ff service nova] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-0c9b096c-aa50-4b57-a2f3-cb48ab0ad3ff req-c2fb4129-9274-4de4-a75b-809b8d6627ff service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] No waiting events found dispatching network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:44:06 user nova-compute[75102]: WARNING nova.compute.manager [req-0c9b096c-aa50-4b57-a2f3-cb48ab0ad3ff req-c2fb4129-9274-4de4-a75b-809b8d6627ff service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received unexpected event network-vif-plugged-7530f992-ba56-418f-abbe-0e16fe005dfb for instance with vm_state active and task_state deleting.
Nov 10 16:44:07 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:44:07 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Took 1.12 seconds to deallocate network for instance.
Nov 10 16:44:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-c0a00677-b3e7-4f71-a79a-fe7542fae3b1 req-dd0013d6-660f-493e-b803-bec311186b0c service nova] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Received event network-vif-deleted-7530f992-ba56-418f-abbe-0e16fe005dfb {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:44:07 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:08 user nova-compute[75102]: INFO nova.compute.manager [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Took 1.08 seconds to detach 1 volumes for instance.
Nov 10 16:44:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: da5d6c88-342c-423d-b0f4-5a18774e91f4] Deleting volume: ad91eebd-e6b0-4f8f-a4ef-5055932f8a24 {{(pid=75102) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 16:44:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:08 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:44:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:44:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.311s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:08 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Deleted allocations for instance da5d6c88-342c-423d-b0f4-5a18774e91f4
Nov 10 16:44:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a050edbb-8992-4857-8547-ac95dc846113 tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "da5d6c88-342c-423d-b0f4-5a18774e91f4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.328s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:09 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:44:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:44:13 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:44:13 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8007MB free_disk=25.167640686035156GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 2237c70c-96db-4b53-98a4-24ae8d0c3abe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 34956fa9-e329-4681-8e37-1bb18def29cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 5e35afc7-c420-46ce-850e-8dc229283819 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b57fe73f-7ce0-4290-9f14-300de96d9e38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:44:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.407s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:44:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:44:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:44:14 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:44:15 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:44:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:44:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:44:15 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:15 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:15 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:44:15 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:44:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-336614a0-8f62-42a0-8579-66ca1243c96b req-922d83cd-661f-457b-a2f2-b08e3e9ea532 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Received event network-changed-add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:44:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-336614a0-8f62-42a0-8579-66ca1243c96b req-922d83cd-661f-457b-a2f2-b08e3e9ea532 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Refreshing instance network info cache due to event network-changed-add0526b-29b8-4df4-b358-c5e79142a734. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:44:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-336614a0-8f62-42a0-8579-66ca1243c96b req-922d83cd-661f-457b-a2f2-b08e3e9ea532 service nova] Acquiring lock "refresh_cache-34956fa9-e329-4681-8e37-1bb18def29cb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:44:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-336614a0-8f62-42a0-8579-66ca1243c96b req-922d83cd-661f-457b-a2f2-b08e3e9ea532 service nova] Acquired lock "refresh_cache-34956fa9-e329-4681-8e37-1bb18def29cb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:44:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-336614a0-8f62-42a0-8579-66ca1243c96b req-922d83cd-661f-457b-a2f2-b08e3e9ea532 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Refreshing network info cache for port add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:44:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "34956fa9-e329-4681-8e37-1bb18def29cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:18 user nova-compute[75102]: DEBUG nova.objects.instance [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'flavor' on Instance uuid 34956fa9-e329-4681-8e37-1bb18def29cb {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:44:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Ignoring supplied device name: /dev/vdb
Nov 10 16:44:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG nova.network.neutron [req-336614a0-8f62-42a0-8579-66ca1243c96b req-922d83cd-661f-457b-a2f2-b08e3e9ea532 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Updated VIF entry in instance network info cache for port add0526b-29b8-4df4-b358-c5e79142a734. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG nova.network.neutron [req-336614a0-8f62-42a0-8579-66ca1243c96b req-922d83cd-661f-457b-a2f2-b08e3e9ea532 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Updating instance_info_cache with network_info: [{"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-336614a0-8f62-42a0-8579-66ca1243c96b req-922d83cd-661f-457b-a2f2-b08e3e9ea532 service nova] Releasing lock "refresh_cache-34956fa9-e329-4681-8e37-1bb18def29cb" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "34956fa9-e329-4681-8e37-1bb18def29cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:44:19 user nova-compute[75102]: INFO nova.compute.manager [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Attaching volume 8d51e82d-55c1-4b53-902a-2e8522f34a63 to /dev/vdb
Nov 10 16:44:19 user nova-compute[75102]: DEBUG os_brick.utils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[549819d3-9448-4d66-a7ea-84db6eb32bb7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[638a5bdf-f804-4b0c-9e3e-22a90b87b246]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38490ca3-dc59-4927-85b4-5d5559369279]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9693ba3-690a-4c80-8dcd-1616cbe06dfb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:44:19 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe23019-3354-4e3e-9c2b-6bd693f3b3de]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG os_brick.utils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Updating existing volume attachment record: c40e5002-cefe-4c12-8e71-8002d0707a39 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:44:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:44:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:44:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWjMorRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:44:42 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:44:42 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:44:42 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8a2943-b705-4fdf-abf1-f2f28833baef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:44:42 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2912b4f-c201-4cf0-bdd7-0b56637f6984]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63] added
Nov 10 16:44:42 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef434ee1-4e69-4a87-9ba0-5a74fca78e4c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[885f9215-c566-430b-8da2-502f132ca6b2]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWjMorRD {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CWjMorRD" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[875a4ff4-fc03-41c9-bde7-e5ececf68f93]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CWjMorRD'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[438644a1-e115-4bb6-92a8-989a95bf622b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fde2c44-24ac-4598-8f54-98b26385e489]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f377b15-7842-434a-9b8b-3d799c81e622]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63, portal: 172.16.0.220,3260]
Nov 10 16:44:43 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63, portal: 172.16.0.220,3260] successful.
Nov 10 16:44:43 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9aa6f4-975a-4cce-b295-0f746a22698b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[053cf1ed-2bc1-4d59-acee-60ca12661bd4]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)
Nov 10 16:44:43 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2d28ca-4152-4b3a-af75-5027a005a3d7]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:44:43 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWjMorRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:44:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.323s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:44:44 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] <== connect_volume: return (1326ms) {'type': 'block', 'scsi_wwn': '26161326531636136', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:44:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26161326531636136', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:44:44 user nova-compute[75102]: DEBUG nova.objects.instance [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'flavor' on Instance uuid 34956fa9-e329-4681-8e37-1bb18def29cb {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:44:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:44:44 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:44:44 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:44:44 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:44:44 user nova-compute[75102]:   <serial>8d51e82d-55c1-4b53-902a-2e8522f34a63</serial>
Nov 10 16:44:44 user nova-compute[75102]: </disk>
Nov 10 16:44:44 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:44:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:44:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:44:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] No VIF found with MAC fa:16:3e:7c:ab:38, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:44:44 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-7135658f-ac5d-4c3e-9f38-cfbf12feee78 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 25.669s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:44:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:44:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:44:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:44:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-fd81e985-8995-4550-863e-19fc524258c0 req-4889f7fc-6522-4643-85c2-f5a98ba1832b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-changed-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-fd81e985-8995-4550-863e-19fc524258c0 req-4889f7fc-6522-4643-85c2-f5a98ba1832b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Refreshing instance network info cache due to event network-changed-2a7fa843-15f0-4f13-b376-9a42119762a9. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fd81e985-8995-4550-863e-19fc524258c0 req-4889f7fc-6522-4643-85c2-f5a98ba1832b service nova] Acquiring lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fd81e985-8995-4550-863e-19fc524258c0 req-4889f7fc-6522-4643-85c2-f5a98ba1832b service nova] Acquired lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG nova.network.neutron [req-fd81e985-8995-4550-863e-19fc524258c0 req-4889f7fc-6522-4643-85c2-f5a98ba1832b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Refreshing network info cache for port 2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG nova.network.neutron [req-fd81e985-8995-4550-863e-19fc524258c0 req-4889f7fc-6522-4643-85c2-f5a98ba1832b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updated VIF entry in instance network info cache for port 2a7fa843-15f0-4f13-b376-9a42119762a9. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG nova.network.neutron [req-fd81e985-8995-4550-863e-19fc524258c0 req-4889f7fc-6522-4643-85c2-f5a98ba1832b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updating instance_info_cache with network_info: [{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-fd81e985-8995-4550-863e-19fc524258c0 req-4889f7fc-6522-4643-85c2-f5a98ba1832b service nova] Releasing lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:45:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:07 user nova-compute[75102]: INFO nova.compute.manager [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Terminating instance
Nov 10 16:45:07 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Instance destroyed successfully.
Nov 10 16:45:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lazy-loading 'resources' on Instance uuid 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:25:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-726645659',display_name='tempest-ServerActionsTestOtherA-server-726645659',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-726645659',id=21,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBJIyuW1YgII5m42ZzPQI/sKQHH3q65mUxP8WzQFSf/4n/JTQ1Wu3opROEkHOGysy1Wt2WY0dRoS8kKXFZZja/7C79VSuXQ0L9aJFgTEonW/PDJXKdDwWpg0JM1ZatQvbg==',key_name='tempest-keypair-394571970',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:26:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='46f5704b433744dd8188e61d576dd461',ramdisk_id='',reservation_id='r-naw2lfj7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1931720116',owner_user_name='tempest-ServerActionsTestOtherA-1931720116-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:26:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7bbea9eecf0b4e998ad458bc0d30a5bf',uuid=82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converting VIF {"id": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "address": "fa:16:3e:7d:dd:57", "network": {"id": "62c05918-11ec-4bb8-8449-96fa1c066aa0", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-197547384-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "46f5704b433744dd8188e61d576dd461", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9cb73dcc-eb", "ovs_interfaceid": "9cb73dcc-ebbc-40a9-8375-49e8fd739c07", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7d:dd:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb73dcc-ebbc-40a9-8375-49e8fd739c07,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb73dcc-eb') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG os_vif [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:dd:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb73dcc-ebbc-40a9-8375-49e8fd739c07,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb73dcc-eb') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9cb73dcc-eb, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2814e1ba-effe-4aea-96d4-98f1fa21e208) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:07 user nova-compute[75102]: INFO os_vif [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7d:dd:57,bridge_name='br-int',has_traffic_filtering=True,id=9cb73dcc-ebbc-40a9-8375-49e8fd739c07,network=Network(62c05918-11ec-4bb8-8449-96fa1c066aa0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9cb73dcc-eb')
Nov 10 16:45:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Deleting instance files /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e_del
Nov 10 16:45:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Deletion of /opt/stack/data/nova/instances/82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e_del complete
Nov 10 16:45:07 user nova-compute[75102]: INFO nova.compute.manager [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 10 16:45:07 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:45:07 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:45:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:45:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:08 user nova-compute[75102]: INFO nova.compute.manager [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Shelving
Nov 10 16:45:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:09 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:09 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Took 1.43 seconds to deallocate network for instance.
Nov 10 16:45:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-cffaa70e-c00c-42ee-86a2-febd9f3df7d6 req-e866eb89-4df5-4f81-b139-f8f2ae641d40 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Received event network-vif-deleted-9cb73dcc-ebbc-40a9-8375-49e8fd739c07 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:09 user nova-compute[75102]: INFO nova.compute.manager [req-cffaa70e-c00c-42ee-86a2-febd9f3df7d6 req-e866eb89-4df5-4f81-b139-f8f2ae641d40 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Neutron deleted interface 9cb73dcc-ebbc-40a9-8375-49e8fd739c07; detaching it from the instance and deleting it from the info cache
Nov 10 16:45:09 user nova-compute[75102]: DEBUG nova.network.neutron [req-cffaa70e-c00c-42ee-86a2-febd9f3df7d6 req-e866eb89-4df5-4f81-b139-f8f2ae641d40 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-cffaa70e-c00c-42ee-86a2-febd9f3df7d6 req-e866eb89-4df5-4f81-b139-f8f2ae641d40 service nova] [instance: 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e] Detach interface failed, port_id=9cb73dcc-ebbc-40a9-8375-49e8fd739c07, reason: Instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:45:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance destroyed successfully.
Nov 10 16:45:09 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:45:09 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:45:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.298s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Beginning cold snapshot process
Nov 10 16:45:09 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Deleted allocations for instance 82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e
Nov 10 16:45:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a2d641fa-ca23-46b1-ab82-f0989a2593cb tempest-ServerActionsTestOtherA-1931720116 tempest-ServerActionsTestOtherA-1931720116-project-member] Lock "82b2e6fe-a0ea-49b7-8dff-1dec20f4a11e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.725s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:09 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:45:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk /opt/stack/data/nova/instances/snapshots/tmpnjhfp3a1/f6e1f0ef39804230bffaae0105859ec3 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "5e35afc7-c420-46ce-850e-8dc229283819" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "5e35afc7-c420-46ce-850e-8dc229283819" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "5e35afc7-c420-46ce-850e-8dc229283819-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:10 user nova-compute[75102]: INFO nova.compute.manager [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Terminating instance
Nov 10 16:45:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk /opt/stack/data/nova/instances/snapshots/tmpnjhfp3a1/f6e1f0ef39804230bffaae0105859ec3" returned: 0 in 0.669s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Snapshot extracted, beginning image upload
Nov 10 16:45:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Instance destroyed successfully.
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'resources' on Instance uuid 5e35afc7-c420-46ce-850e-8dc229283819 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:43:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1621605347',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1621605347',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1621605347',id=44,image_ref='d8d1a951-b810-48fa-bac0-8f5c2918a571',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhyZ87xTycLKizyF8nUpeVCRetb1+Yjcmp3bAA2WIW8e/rn8sbYQFY/SCi/lI+R70tEzIdIKS2bvvoVzC2AqnhpAd4LRwQwaiWujUbN4I4gObszZQ+JTkYP4dze9/xDiA==',key_name='tempest-keypair-338786039',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:44:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-4xrj8emj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1535704831',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:44:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96544e5daa74d51a232f565129b328a',uuid=5e35afc7-c420-46ce-850e-8dc229283819,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=3ed3c810-8477-42f8-bd83-91a61098aa01,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3c810-84') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_vif [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=3ed3c810-8477-42f8-bd83-91a61098aa01,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3c810-84') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ed3c810-84, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received event network-changed-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Refreshing instance network info cache due to event network-changed-3ed3c810-8477-42f8-bd83-91a61098aa01. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] Acquiring lock "refresh_cache-5e35afc7-c420-46ce-850e-8dc229283819" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] Acquired lock "refresh_cache-5e35afc7-c420-46ce-850e-8dc229283819" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Refreshing network info cache for port 3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=87881ab5-5f71-40cb-b2f2-84f29a2f1c25) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:11 user nova-compute[75102]: INFO os_vif [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:fd:b8,bridge_name='br-int',has_traffic_filtering=True,id=3ed3c810-8477-42f8-bd83-91a61098aa01,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ed3c810-84')
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IfXznkvQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:45:11 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb0a3aa-ef72-447a-af97-efa14a12f821]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:45:11 user nova-compute[75102]: No targets found.
Nov 10 16:45:11 user nova-compute[75102]: iSNS:
Nov 10 16:45:11 user nova-compute[75102]: No targets found.
Nov 10 16:45:11 user nova-compute[75102]: STATIC:
Nov 10 16:45:11 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63
Nov 10 16:45:11 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:45:11 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:45:11 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052
Nov 10 16:45:11 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:45:11 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:45:11 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334
Nov 10 16:45:11 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:45:11 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:45:11 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35
Nov 10 16:45:11 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:45:11 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:45:11 user nova-compute[75102]: FIRMWARE:
Nov 10 16:45:11 user nova-compute[75102]: No targets found.
Nov 10 16:45:11 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:45:11 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:45:11 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9a0b17e-ea84-4f1f-8a3e-f2f6b5d3b5a7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ab3655-d405-4f29-9263-1e0bea319b31]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:45:11 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:45:11 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:45:11 user nova-compute[75102]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)
Nov 10 16:45:11 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:45:11 user nova-compute[75102]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 (non-flash)
Nov 10 16:45:11 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:45:11 user nova-compute[75102]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)
Nov 10 16:45:11 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f85c295a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0535d6b6-6d47-4491-ae8a-9a08238e5739]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1028247e-aad5-43d7-b2fd-50fc267d6c24]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d96877-c18f-4a90-8c85-42fae16dabb1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6ec2ba-500f-4c05-ad3c-c32faf2eb16b]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab3d144-8570-4995-8f1a-c61390763916]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c211a0-82af-48ef-9a23-dd9446652e71]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052, portal: 172.16.0.220,3260]
Nov 10 16:45:11 user nova-compute[75102]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052, portal: 172.16.0.220,3260] successful.
Nov 10 16:45:11 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55c21e96-4aec-4e65-b706-c92345f30052 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[813affce-4237-412b-a712-63797e7801eb]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.390s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== disconnect_volume: return (393ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:45:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Deleting instance files /opt/stack/data/nova/instances/5e35afc7-c420-46ce-850e-8dc229283819_del
Nov 10 16:45:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Deletion of /opt/stack/data/nova/instances/5e35afc7-c420-46ce-850e-8dc229283819_del complete
Nov 10 16:45:11 user nova-compute[75102]: INFO nova.compute.manager [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Updated VIF entry in instance network info cache for port 3ed3c810-8477-42f8-bd83-91a61098aa01. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Updating instance_info_cache with network_info: [{"id": "3ed3c810-8477-42f8-bd83-91a61098aa01", "address": "fa:16:3e:8a:fd:b8", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.58", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ed3c810-84", "ovs_interfaceid": "3ed3c810-8477-42f8-bd83-91a61098aa01", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] Releasing lock "refresh_cache-5e35afc7-c420-46ce-850e-8dc229283819" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received event network-vif-unplugged-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] Acquiring lock "5e35afc7-c420-46ce-850e-8dc229283819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] No waiting events found dispatching network-vif-unplugged-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received event network-vif-unplugged-3ed3c810-8477-42f8-bd83-91a61098aa01 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received event network-vif-plugged-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] Acquiring lock "5e35afc7-c420-46ce-850e-8dc229283819-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] Lock "5e35afc7-c420-46ce-850e-8dc229283819-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] No waiting events found dispatching network-vif-plugged-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:45:11 user nova-compute[75102]: WARNING nova.compute.manager [req-bef81e2b-271c-4af4-8ce9-4273d559568a req-28ce5724-b482-4d54-b2e7-153a60d055e8 service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received unexpected event network-vif-plugged-3ed3c810-8477-42f8-bd83-91a61098aa01 for instance with vm_state active and task_state deleting.
Nov 10 16:45:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-967974c7-d5da-44ba-b37c-e4ff025740a9 req-4866445a-5ab9-4a3e-94e8-2f1cc3804ee2 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-unplugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-967974c7-d5da-44ba-b37c-e4ff025740a9 req-4866445a-5ab9-4a3e-94e8-2f1cc3804ee2 service nova] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-967974c7-d5da-44ba-b37c-e4ff025740a9 req-4866445a-5ab9-4a3e-94e8-2f1cc3804ee2 service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-967974c7-d5da-44ba-b37c-e4ff025740a9 req-4866445a-5ab9-4a3e-94e8-2f1cc3804ee2 service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-967974c7-d5da-44ba-b37c-e4ff025740a9 req-4866445a-5ab9-4a3e-94e8-2f1cc3804ee2 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] No waiting events found dispatching network-vif-unplugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:45:12 user nova-compute[75102]: WARNING nova.compute.manager [req-967974c7-d5da-44ba-b37c-e4ff025740a9 req-4866445a-5ab9-4a3e-94e8-2f1cc3804ee2 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received unexpected event network-vif-unplugged-2a7fa843-15f0-4f13-b376-9a42119762a9 for instance with vm_state active and task_state shelving_image_uploading.
Nov 10 16:45:12 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:12 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Took 1.09 seconds to deallocate network for instance.
Nov 10 16:45:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-5b459300-ffb0-459c-b91a-7e4263eef75d req-5a44e12f-a0a5-4e1d-a8e6-629074a67dce service nova] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Received event network-vif-deleted-3ed3c810-8477-42f8-bd83-91a61098aa01 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:13 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Snapshot image upload complete
Nov 10 16:45:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:45:13 user nova-compute[75102]: INFO nova.compute.manager [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Shelve offloading
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:13 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance destroyed successfully.
Nov 10 16:45:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquired lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:45:13 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:14 user nova-compute[75102]: INFO nova.compute.manager [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Took 1.17 seconds to detach 1 volumes for instance.
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-99b39a8d-8584-4de7-b9fe-f32b9624e160 req-6bb6ea06-8d1e-43fa-8bb0-9062259176bd service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-99b39a8d-8584-4de7-b9fe-f32b9624e160 req-6bb6ea06-8d1e-43fa-8bb0-9062259176bd service nova] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-99b39a8d-8584-4de7-b9fe-f32b9624e160 req-6bb6ea06-8d1e-43fa-8bb0-9062259176bd service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-99b39a8d-8584-4de7-b9fe-f32b9624e160 req-6bb6ea06-8d1e-43fa-8bb0-9062259176bd service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-99b39a8d-8584-4de7-b9fe-f32b9624e160 req-6bb6ea06-8d1e-43fa-8bb0-9062259176bd service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] No waiting events found dispatching network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:45:14 user nova-compute[75102]: WARNING nova.compute.manager [req-99b39a8d-8584-4de7-b9fe-f32b9624e160 req-6bb6ea06-8d1e-43fa-8bb0-9062259176bd service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received unexpected event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 for instance with vm_state shelved and task_state shelving_offloading.
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 5e35afc7-c420-46ce-850e-8dc229283819] Deleting volume: 55c21e96-4aec-4e65-b706-c92345f30052 {{(pid=75102) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.network.neutron [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updating instance_info_cache with network_info: [{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Releasing lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:45:14 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:45:14 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:45:14 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8443MB free_disk=25.087509155273438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:45:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.949s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.295s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:15 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Deleted allocations for instance 5e35afc7-c420-46ce-850e-8dc229283819
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 2237c70c-96db-4b53-98a4-24ae8d0c3abe actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 34956fa9-e329-4681-8e37-1bb18def29cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance b57fe73f-7ce0-4290-9f14-300de96d9e38 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f7aac1dd-5703-404c-8be3-916c7c67fe57 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "5e35afc7-c420-46ce-850e-8dc229283819" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.927s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.362s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance destroyed successfully.
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'resources' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-800447560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-800447560',id=43,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9Iv2sEN9Z9IGQzI64NWZQAK+DCOamr6sw77MfIYQMebL7N/P15VDSV+5my1oNSWIcEk5NzDjBDOfc1jZR9RFaplw1rxj8gr3GUDIh7PFk1HOk6texLXVK2iFgJK+pwjw==',key_name='tempest-keypair-287893862',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:43:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='b656df48b2114d27a9bf9fe6df81037f',ramdisk_id='',reservation_id='r-pejfuw9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1377452369',owner_user_name='tempest-AttachVolumeShelveTestJSON-1377452369-project-member',shelved_at='2023-11-10T16:45:13.727974',shelved_host='user',shelved_image_id='cc3bbcdb-24a1-4d0a-b31a-9b2e8b3f64bb'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:45:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50787ee821e0400eb445fe8cd891e119',uuid=8ca14a6f-0eb8-42e4-a062-ea94d3e771e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converting VIF {"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG os_vif [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a7fa843-15, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a140ad6-5ecf-42ec-8a52-7675ad097371) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:45:15 user nova-compute[75102]: INFO os_vif [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15')
Nov 10 16:45:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Deleting instance files /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5_del
Nov 10 16:45:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Deletion of /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5_del complete
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-55b5e8c1-6692-43bd-82ee-cdfe93fa5480 req-9c733064-d9b4-49b1-aa6a-38082b914d1b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-changed-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.compute.manager [req-55b5e8c1-6692-43bd-82ee-cdfe93fa5480 req-9c733064-d9b4-49b1-aa6a-38082b914d1b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Refreshing instance network info cache due to event network-changed-2a7fa843-15f0-4f13-b376-9a42119762a9. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-55b5e8c1-6692-43bd-82ee-cdfe93fa5480 req-9c733064-d9b4-49b1-aa6a-38082b914d1b service nova] Acquiring lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-55b5e8c1-6692-43bd-82ee-cdfe93fa5480 req-9c733064-d9b4-49b1-aa6a-38082b914d1b service nova] Acquired lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.network.neutron [req-55b5e8c1-6692-43bd-82ee-cdfe93fa5480 req-9c733064-d9b4-49b1-aa6a-38082b914d1b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Refreshing network info cache for port 2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:45:15 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Deleted allocations for instance 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5
Nov 10 16:45:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:45:15 user nova-compute[75102]: DEBUG nova.objects.base [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Object Instance<8ca14a6f-0eb8-42e4-a062-ea94d3e771e5> lazy-loaded attributes: resources,numa_topology {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.312s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG nova.network.neutron [req-55b5e8c1-6692-43bd-82ee-cdfe93fa5480 req-9c733064-d9b4-49b1-aa6a-38082b914d1b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updated VIF entry in instance network info cache for port 2a7fa843-15f0-4f13-b376-9a42119762a9. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG nova.network.neutron [req-55b5e8c1-6692-43bd-82ee-cdfe93fa5480 req-9c733064-d9b4-49b1-aa6a-38082b914d1b service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updating instance_info_cache with network_info: [{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap2a7fa843-15", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f237c3ee-b0f4-4f7b-842b-7c6ee0820aed tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 7.563s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-55b5e8c1-6692-43bd-82ee-cdfe93fa5480 req-9c733064-d9b4-49b1-aa6a-38082b914d1b service nova] Releasing lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:45:16 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid 2237c70c-96db-4b53-98a4-24ae8d0c3abe {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:45:17 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Updating instance_info_cache with network_info: [{"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-2237c70c-96db-4b53-98a4-24ae8d0c3abe" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:45:17 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:45:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:45:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:45:19 user nova-compute[75102]: INFO nova.compute.claims [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Claim successful on node user
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.289s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:45:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:45:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Creating image(s)
Nov 10 16:45:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "/opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "/opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "/opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG nova.policy [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b1288107335b4917aec11482f38508ec', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dfff2444d6464eb0bf0ed2b70ecd9632', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:45:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.167s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk 1073741824" returned: 0 in 0.051s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.225s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.166s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Cannot resize image /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Ensure instance console log exists: /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-1679fe72-bd3c-4ab1-99b0-b4f3553969ad req-ba7be2aa-17f7-4bd3-9d45-52dc0aca829e service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-1679fe72-bd3c-4ab1-99b0-b4f3553969ad req-ba7be2aa-17f7-4bd3-9d45-52dc0aca829e service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing instance network info cache due to event network-changed-41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1679fe72-bd3c-4ab1-99b0-b4f3553969ad req-ba7be2aa-17f7-4bd3-9d45-52dc0aca829e service nova] Acquiring lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1679fe72-bd3c-4ab1-99b0-b4f3553969ad req-ba7be2aa-17f7-4bd3-9d45-52dc0aca829e service nova] Acquired lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-1679fe72-bd3c-4ab1-99b0-b4f3553969ad req-ba7be2aa-17f7-4bd3-9d45-52dc0aca829e service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Refreshing network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:21 user nova-compute[75102]: INFO nova.compute.manager [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Terminating instance
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.network.neutron [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Successfully created port: f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-8b8ea468-2685-44a3-bc97-a409c8a0a440 req-6b48b062-00d1-430b-ba62-90763f4f1a98 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-unplugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8b8ea468-2685-44a3-bc97-a409c8a0a440 req-6b48b062-00d1-430b-ba62-90763f4f1a98 service nova] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8b8ea468-2685-44a3-bc97-a409c8a0a440 req-6b48b062-00d1-430b-ba62-90763f4f1a98 service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8b8ea468-2685-44a3-bc97-a409c8a0a440 req-6b48b062-00d1-430b-ba62-90763f4f1a98 service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-8b8ea468-2685-44a3-bc97-a409c8a0a440 req-6b48b062-00d1-430b-ba62-90763f4f1a98 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] No waiting events found dispatching network-vif-unplugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-8b8ea468-2685-44a3-bc97-a409c8a0a440 req-6b48b062-00d1-430b-ba62-90763f4f1a98 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-unplugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-1679fe72-bd3c-4ab1-99b0-b4f3553969ad req-ba7be2aa-17f7-4bd3-9d45-52dc0aca829e service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updated VIF entry in instance network info cache for port 41c704f1-d29a-491b-9f9f-d1d4e3badf13. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-1679fe72-bd3c-4ab1-99b0-b4f3553969ad req-ba7be2aa-17f7-4bd3-9d45-52dc0aca829e service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [{"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-1679fe72-bd3c-4ab1-99b0-b4f3553969ad req-ba7be2aa-17f7-4bd3-9d45-52dc0aca829e service nova] Releasing lock "refresh_cache-b57fe73f-7ce0-4290-9f14-300de96d9e38" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:45:22 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Instance destroyed successfully.
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.objects.instance [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lazy-loading 'resources' on Instance uuid b57fe73f-7ce0-4290-9f14-300de96d9e38 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:39:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-1971436327',display_name='tempest-TestShelveInstance-server-1971436327',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-1971436327',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEmWswTifVR81PjbzdI9ymWWUXNhpQ0j1viup1f7qEgXcRBOnJrEhKddKHYWk8zUUQMJCwde0yp39CzlCdLrw7tXOZollMQO4SchG7cVgghMd/x4lwDXcRBqtv/uZ4hsQ==',key_name='tempest-TestShelveInstance-1509801576',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:44:02Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b7089a983faf4dbebfc6f9514a154c83',ramdisk_id='',reservation_id='r-he2uv6iq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-188193481',owner_user_name='tempest-TestShelveInstance-188193481-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:44:02Z,user_data=None,user_id='190f5287874a4a04a1436f7c6b5213d7',uuid=b57fe73f-7ce0-4290-9f14-300de96d9e38,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converting VIF {"id": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "address": "fa:16:3e:67:34:f2", "network": {"id": "15408811-ce5b-4ce2-ac67-d7a908a737bf", "bridge": "br-int", "label": "tempest-TestShelveInstance-6903973-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.102", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b7089a983faf4dbebfc6f9514a154c83", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap41c704f1-d2", "ovs_interfaceid": "41c704f1-d29a-491b-9f9f-d1d4e3badf13", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_vif [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap41c704f1-d2, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fd8a2b6e-cbfa-4a56-ab7c-de3d945231d6) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:45:22 user nova-compute[75102]: INFO os_vif [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:67:34:f2,bridge_name='br-int',has_traffic_filtering=True,id=41c704f1-d29a-491b-9f9f-d1d4e3badf13,network=Network(15408811-ce5b-4ce2-ac67-d7a908a737bf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap41c704f1-d2')
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PmLjEcxl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:45:22 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.neutron [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Successfully updated port: f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquired lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.neutron [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db856c4-8fa9-4f78-abd3-663fdb7fc2a1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:45:22 user nova-compute[75102]: No targets found.
Nov 10 16:45:22 user nova-compute[75102]: iSNS:
Nov 10 16:45:22 user nova-compute[75102]: No targets found.
Nov 10 16:45:22 user nova-compute[75102]: STATIC:
Nov 10 16:45:22 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63
Nov 10 16:45:22 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:45:22 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:45:22 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334
Nov 10 16:45:22 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:45:22 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:45:22 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35
Nov 10 16:45:22 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:45:22 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:45:22 user nova-compute[75102]: FIRMWARE:
Nov 10 16:45:22 user nova-compute[75102]: No targets found.
Nov 10 16:45:22 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:45:22 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:45:22 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf80162e-ada6-4696-9149-d6a846acb8f8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ef6df0-c09a-4266-8f34-74bf17195425]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:45:22 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:45:22 user nova-compute[75102]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)
Nov 10 16:45:22 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:45:22 user nova-compute[75102]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 (non-flash)
Nov 10 16:45:22 user nova-compute[75102]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)
Nov 10 16:45:22 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f5442f0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334'): ({'sde'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Removing single pathed devices sde {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.neutron [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1029f29-b7dd-4481-93bf-6f2318fbc455]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[527a87b0-aa2b-489f-a54c-77afb23535fa]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Flushing IO for device /dev/sde {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9eb34a5-841e-4074-856e-11f0c75ef571]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.052s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8db6676-d208-4290-a92d-daedb3d4285f]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] SCSI volumes sde have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_65002923', '/dev/disk/by-id/scsi-1SCST_BIO65002923-fa87124dc95c2cee', '/dev/disk/by-id/scsi-26661383731323464') {{(pid=85940) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0cd4ac-02d6-4a02-aeda-290fefd332c5]: (4, None) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a118abcc-4feb-40cb-b015-5ba41819b869]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e293f5a-30cc-4f30-b066-61ad3f549403]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260]
Nov 10 16:45:22 user nova-compute[75102]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334, portal: 172.16.0.220,3260] successful.
Nov 10 16:45:22 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c728d84-7f73-45ab-9cd6-475ca4b19334 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5945a41-648c-4d63-bba0-44ee28d28af9]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.437s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] <== disconnect_volume: return (439ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:45:22 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Deleting instance files /opt/stack/data/nova/instances/b57fe73f-7ce0-4290-9f14-300de96d9e38_del
Nov 10 16:45:22 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Deletion of /opt/stack/data/nova/instances/b57fe73f-7ce0-4290-9f14-300de96d9e38_del complete
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.neutron [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating instance_info_cache with network_info: [{"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Releasing lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Instance network_info: |[{"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Start _get_guest_xml network_info=[{"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:45:22 user nova-compute[75102]: INFO nova.compute.manager [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Took 1.60 seconds to destroy the instance on the hypervisor.
Nov 10 16:45:22 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:45:22 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:45:22 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1099820247',display_name='tempest-SnapshotDataIntegrityTests-server-1099820247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1099820247',id=45,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMNpu11uolMmOOlrbcOMvniHI2BuBvpridRlVJi/GBULwbUP3QhVmNvGiOAPzx46Dt6Y0JJiHrb7mbfu9svT9M9TpYaLf/FxOD/SbnfVXgz796d3PJHVD3/MSonRpf78Q==',key_name='tempest-keypair-838950257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfff2444d6464eb0bf0ed2b70ecd9632',ramdisk_id='',reservation_id='r-bvrtilkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1928124122',owner_user_name='tempest-SnapshotDataIntegrityTests-1928124122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1288107335b4917aec11482f38508ec',uuid=3df267ce-8bcb-41bb-bf17-b13f1cecd5f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Converting VIF {"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:95:f1,bridge_name='br-int',has_traffic_filtering=True,id=f5f212dd-f32e-4263-aa46-5176ea1a32d9,network=Network(2db41338-c774-42e4-a415-9a8a1e6a7f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f212dd-f3') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.objects.instance [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'pci_devices' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:45:22 user nova-compute[75102]:   <uuid>3df267ce-8bcb-41bb-bf17-b13f1cecd5f5</uuid>
Nov 10 16:45:22 user nova-compute[75102]:   <name>instance-0000002d</name>
Nov 10 16:45:22 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:45:22 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:45:22 user nova-compute[75102]:   <metadata>
Nov 10 16:45:22 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:45:22 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:45:22 user nova-compute[75102]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1099820247</nova:name>
Nov 10 16:45:22 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:45:22</nova:creationTime>
Nov 10 16:45:22 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:45:22 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:45:22 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:45:22 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:45:22 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:45:22 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:45:22 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:45:22 user nova-compute[75102]:       <nova:owner>
Nov 10 16:45:22 user nova-compute[75102]:         <nova:user uuid="b1288107335b4917aec11482f38508ec">tempest-SnapshotDataIntegrityTests-1928124122-project-member</nova:user>
Nov 10 16:45:22 user nova-compute[75102]:         <nova:project uuid="dfff2444d6464eb0bf0ed2b70ecd9632">tempest-SnapshotDataIntegrityTests-1928124122</nova:project>
Nov 10 16:45:22 user nova-compute[75102]:       </nova:owner>
Nov 10 16:45:22 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:45:22 user nova-compute[75102]:       <nova:ports>
Nov 10 16:45:22 user nova-compute[75102]:         <nova:port uuid="f5f212dd-f32e-4263-aa46-5176ea1a32d9">
Nov 10 16:45:22 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 10 16:45:22 user nova-compute[75102]:         </nova:port>
Nov 10 16:45:22 user nova-compute[75102]:       </nova:ports>
Nov 10 16:45:22 user nova-compute[75102]:     </nova:instance>
Nov 10 16:45:22 user nova-compute[75102]:   </metadata>
Nov 10 16:45:22 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:45:22 user nova-compute[75102]:     <system>
Nov 10 16:45:22 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:45:22 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:45:22 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:45:22 user nova-compute[75102]:       <entry name="serial">3df267ce-8bcb-41bb-bf17-b13f1cecd5f5</entry>
Nov 10 16:45:22 user nova-compute[75102]:       <entry name="uuid">3df267ce-8bcb-41bb-bf17-b13f1cecd5f5</entry>
Nov 10 16:45:22 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:45:22 user nova-compute[75102]:     </system>
Nov 10 16:45:22 user nova-compute[75102]:   </sysinfo>
Nov 10 16:45:22 user nova-compute[75102]:   <os>
Nov 10 16:45:22 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:45:22 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:45:22 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:45:22 user nova-compute[75102]:   </os>
Nov 10 16:45:22 user nova-compute[75102]:   <features>
Nov 10 16:45:22 user nova-compute[75102]:     <acpi/>
Nov 10 16:45:22 user nova-compute[75102]:     <apic/>
Nov 10 16:45:22 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:45:22 user nova-compute[75102]:   </features>
Nov 10 16:45:22 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:45:22 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:45:22 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:45:22 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:45:22 user nova-compute[75102]:   </clock>
Nov 10 16:45:22 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:45:22 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:45:22 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:45:22 user nova-compute[75102]:   </cpu>
Nov 10 16:45:22 user nova-compute[75102]:   <devices>
Nov 10 16:45:22 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:45:22 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:45:22 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk"/>
Nov 10 16:45:22 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:45:22 user nova-compute[75102]:     </disk>
Nov 10 16:45:22 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:45:22 user nova-compute[75102]:       <mac address="fa:16:3e:97:95:f1"/>
Nov 10 16:45:22 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:45:22 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:45:22 user nova-compute[75102]:       <target dev="tapf5f212dd-f3"/>
Nov 10 16:45:22 user nova-compute[75102]:     </interface>
Nov 10 16:45:22 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:45:22 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/console.log" append="off"/>
Nov 10 16:45:22 user nova-compute[75102]:     </serial>
Nov 10 16:45:22 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:45:22 user nova-compute[75102]:     <video>
Nov 10 16:45:22 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:45:22 user nova-compute[75102]:     </video>
Nov 10 16:45:22 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:45:22 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:45:22 user nova-compute[75102]:     </rng>
Nov 10 16:45:22 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:45:22 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:45:22 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:45:22 user nova-compute[75102]:     </memballoon>
Nov 10 16:45:22 user nova-compute[75102]:   </devices>
Nov 10 16:45:22 user nova-compute[75102]: </domain>
Nov 10 16:45:22 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1099820247',display_name='tempest-SnapshotDataIntegrityTests-server-1099820247',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1099820247',id=45,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMNpu11uolMmOOlrbcOMvniHI2BuBvpridRlVJi/GBULwbUP3QhVmNvGiOAPzx46Dt6Y0JJiHrb7mbfu9svT9M9TpYaLf/FxOD/SbnfVXgz796d3PJHVD3/MSonRpf78Q==',key_name='tempest-keypair-838950257',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='dfff2444d6464eb0bf0ed2b70ecd9632',ramdisk_id='',reservation_id='r-bvrtilkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1928124122',owner_user_name='tempest-SnapshotDataIntegrityTests-1928124122-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:45:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1288107335b4917aec11482f38508ec',uuid=3df267ce-8bcb-41bb-bf17-b13f1cecd5f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Converting VIF {"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:95:f1,bridge_name='br-int',has_traffic_filtering=True,id=f5f212dd-f32e-4263-aa46-5176ea1a32d9,network=Network(2db41338-c774-42e4-a415-9a8a1e6a7f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f212dd-f3') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG os_vif [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:95:f1,bridge_name='br-int',has_traffic_filtering=True,id=f5f212dd-f32e-4263-aa46-5176ea1a32d9,network=Network(2db41338-c774-42e4-a415-9a8a1e6a7f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f212dd-f3') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a1dcb6c4-2a56-5fd1-b0c5-28ef79483f9c', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf5f212dd-f3, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf5f212dd-f3, col_values=(('qos', UUID('432ece3c-ddc8-48f5-b18a-b072a29adf04')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf5f212dd-f3, col_values=(('external_ids', {'iface-id': 'f5f212dd-f32e-4263-aa46-5176ea1a32d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:95:f1', 'vm-uuid': '3df267ce-8bcb-41bb-bf17-b13f1cecd5f5'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:22 user nova-compute[75102]: INFO os_vif [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:95:f1,bridge_name='br-int',has_traffic_filtering=True,id=f5f212dd-f32e-4263-aa46-5176ea1a32d9,network=Network(2db41338-c774-42e4-a415-9a8a1e6a7f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f212dd-f3')
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:45:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No VIF found with MAC fa:16:3e:97:95:f1, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-bcc5942a-3d55-48ee-b959-a12b7d8c0e6b req-1abe7dfb-1872-4912-8d4a-8745b0fed847 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received event network-changed-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-bcc5942a-3d55-48ee-b959-a12b7d8c0e6b req-1abe7dfb-1872-4912-8d4a-8745b0fed847 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Refreshing instance network info cache due to event network-changed-f5f212dd-f32e-4263-aa46-5176ea1a32d9. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bcc5942a-3d55-48ee-b959-a12b7d8c0e6b req-1abe7dfb-1872-4912-8d4a-8745b0fed847 service nova] Acquiring lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bcc5942a-3d55-48ee-b959-a12b7d8c0e6b req-1abe7dfb-1872-4912-8d4a-8745b0fed847 service nova] Acquired lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-bcc5942a-3d55-48ee-b959-a12b7d8c0e6b req-1abe7dfb-1872-4912-8d4a-8745b0fed847 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Refreshing network info cache for port f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:23 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Took 0.56 seconds to deallocate network for instance.
Nov 10 16:45:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-bcc5942a-3d55-48ee-b959-a12b7d8c0e6b req-1abe7dfb-1872-4912-8d4a-8745b0fed847 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updated VIF entry in instance network info cache for port f5f212dd-f32e-4263-aa46-5176ea1a32d9. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG nova.network.neutron [req-bcc5942a-3d55-48ee-b959-a12b7d8c0e6b req-1abe7dfb-1872-4912-8d4a-8745b0fed847 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating instance_info_cache with network_info: [{"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-bcc5942a-3d55-48ee-b959-a12b7d8c0e6b req-1abe7dfb-1872-4912-8d4a-8745b0fed847 service nova] Releasing lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-55d1c218-5391-4844-8e30-0394b4c1dcf9 req-1d4a2c73-0b05-455b-8e51-3adf2fa68d0a service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-55d1c218-5391-4844-8e30-0394b4c1dcf9 req-1d4a2c73-0b05-455b-8e51-3adf2fa68d0a service nova] Acquiring lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-55d1c218-5391-4844-8e30-0394b4c1dcf9 req-1d4a2c73-0b05-455b-8e51-3adf2fa68d0a service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-55d1c218-5391-4844-8e30-0394b4c1dcf9 req-1d4a2c73-0b05-455b-8e51-3adf2fa68d0a service nova] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:23 user nova-compute[75102]: DEBUG nova.compute.manager [req-55d1c218-5391-4844-8e30-0394b4c1dcf9 req-1d4a2c73-0b05-455b-8e51-3adf2fa68d0a service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] No waiting events found dispatching network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:45:23 user nova-compute[75102]: WARNING nova.compute.manager [req-55d1c218-5391-4844-8e30-0394b4c1dcf9 req-1d4a2c73-0b05-455b-8e51-3adf2fa68d0a service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received unexpected event network-vif-plugged-41c704f1-d29a-491b-9f9f-d1d4e3badf13 for instance with vm_state active and task_state deleting.
Nov 10 16:45:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:24 user nova-compute[75102]: INFO nova.compute.manager [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Took 1.18 seconds to detach 1 volumes for instance.
Nov 10 16:45:24 user nova-compute[75102]: DEBUG nova.compute.manager [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Deleting volume: 3c728d84-7f73-45ab-9cd6-475ca4b19334 {{(pid=75102) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 16:45:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:24 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:45:24 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:45:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.249s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:24 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Deleted allocations for instance b57fe73f-7ce0-4290-9f14-300de96d9e38
Nov 10 16:45:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-30ecea3c-6ac5-4bd6-ac03-d877d72eabe7 tempest-TestShelveInstance-188193481 tempest-TestShelveInstance-188193481-project-member] Lock "b57fe73f-7ce0-4290-9f14-300de96d9e38" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.895s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] [instance: b57fe73f-7ce0-4290-9f14-300de96d9e38] Received event network-vif-deleted-41c704f1-d29a-491b-9f9f-d1d4e3badf13 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received event network-vif-plugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] No waiting events found dispatching network-vif-plugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:45:25 user nova-compute[75102]: WARNING nova.compute.manager [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received unexpected event network-vif-plugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 for instance with vm_state building and task_state spawning.
Nov 10 16:45:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received event network-vif-plugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:25 user nova-compute[75102]: DEBUG nova.compute.manager [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] No waiting events found dispatching network-vif-plugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:45:25 user nova-compute[75102]: WARNING nova.compute.manager [req-ce984603-b11e-4612-9132-7172e4a5c3b4 req-17b35122-a16b-4c8d-91f5-63e99ec4b568 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received unexpected event network-vif-plugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 for instance with vm_state building and task_state spawning.
Nov 10 16:45:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:45:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Instance spawned successfully.
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:45:26 user nova-compute[75102]: INFO nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Took 6.99 seconds to spawn the instance on the hypervisor.
Nov 10 16:45:26 user nova-compute[75102]: DEBUG nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:45:26 user nova-compute[75102]: INFO nova.compute.manager [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Took 7.62 seconds to build instance.
Nov 10 16:45:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-51e5a655-cf4d-4852-a358-7ab37e023c6e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.757s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:45:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "34956fa9-e329-4681-8e37-1bb18def29cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:45:47 user nova-compute[75102]: INFO nova.compute.manager [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Detaching volume 8d51e82d-55c1-4b53-902a-2e8522f34a63
Nov 10 16:45:47 user nova-compute[75102]: INFO nova.virt.block_device [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Attempting to driver detach volume 8d51e82d-55c1-4b53-902a-2e8522f34a63 from mountpoint /dev/vdb
Nov 10 16:45:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Attempting to detach device vdb from instance 34956fa9-e329-4681-8e37-1bb18def29cb from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:45:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:45:47 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:45:47 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:45:47 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:45:47 user nova-compute[75102]:   <serial>8d51e82d-55c1-4b53-902a-2e8522f34a63</serial>
Nov 10 16:45:47 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:45:47 user nova-compute[75102]: </disk>
Nov 10 16:45:47 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:45:47 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Successfully detached device vdb from instance 34956fa9-e329-4681-8e37-1bb18def29cb from the persistent domain config.
Nov 10 16:45:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 34956fa9-e329-4681-8e37-1bb18def29cb from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:45:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:45:47 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:45:47 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:45:47 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:45:47 user nova-compute[75102]:   <serial>8d51e82d-55c1-4b53-902a-2e8522f34a63</serial>
Nov 10 16:45:47 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:45:47 user nova-compute[75102]: </disk>
Nov 10 16:45:47 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:45:47 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "34956fa9-e329-4681-8e37-1bb18def29cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:45:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 34956fa9-e329-4681-8e37-1bb18def29cb {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:45:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:45:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 34956fa9-e329-4681-8e37-1bb18def29cb is timed out.
Nov 10 16:46:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Successfully detached device vdb from instance 34956fa9-e329-4681-8e37-1bb18def29cb from the live domain config.
Nov 10 16:46:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWjMorRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:46:07 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[06cbd4ab-c2c3-4697-9d66-6f6f3886ae90]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:46:07 user nova-compute[75102]: No targets found.
Nov 10 16:46:07 user nova-compute[75102]: iSNS:
Nov 10 16:46:07 user nova-compute[75102]: No targets found.
Nov 10 16:46:07 user nova-compute[75102]: STATIC:
Nov 10 16:46:07 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63
Nov 10 16:46:07 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:46:07 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:46:07 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35
Nov 10 16:46:07 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:46:07 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:46:07 user nova-compute[75102]: FIRMWARE:
Nov 10 16:46:07 user nova-compute[75102]: No targets found.
Nov 10 16:46:07 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:46:07 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:46:07 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[46e36337-89c9-4ee6-885e-212f8f64b9f9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b013f3a-edf8-4e85-ba45-883d9a44aa75]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:46:07 user nova-compute[75102]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)
Nov 10 16:46:07 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:46:07 user nova-compute[75102]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 (non-flash)
Nov 10 16:46:07 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f745848b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[301c5dca-0190-4461-9b15-8e4c788b79c3]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad89106-17ef-424f-b5ca-d201e171b7d1]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[03d53e1b-a0d8-49be-836f-4c7415c8a0a0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ecbb1cb-e464-4dc9-9bcc-ce4d815126ef]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b34b71-775e-43cf-adc3-f65fa993ccd3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bc1de58-fafa-4989-adb2-20d2b25f73de]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63, portal: 172.16.0.220,3260]
Nov 10 16:46:07 user nova-compute[75102]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63, portal: 172.16.0.220,3260] successful.
Nov 10 16:46:07 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[df0c0e15-c3e7-45f9-a3b2-5cdf983c400f]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.285s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] <== disconnect_volume: return (285ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:46:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:46:08 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG nova.objects.instance [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'flavor' on Instance uuid 34956fa9-e329-4681-8e37-1bb18def29cb {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-b80421e1-3cd0-49e3-8d44-ca67476b319f tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.133s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.979s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "34956fa9-e329-4681-8e37-1bb18def29cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:09 user nova-compute[75102]: INFO nova.compute.manager [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Terminating instance
Nov 10 16:46:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:46:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Instance destroyed successfully.
Nov 10 16:46:09 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lazy-loading 'resources' on Instance uuid 34956fa9-e329-4681-8e37-1bb18def29cb {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:42:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-193396418',display_name='tempest-VolumesSnapshotTestJSON-instance-193396418',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-193396418',id=42,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJNlyNeVGRaQw9uIZZS4SV76DhLgXDPGx7JBSwbY1ZKIZgWKQCgFaMb1wsI0L2V8pBMbiLA2kAtKamKexoaFrvjNnxI3WahLIV/V7ACUo/destg9Lh7BudK7MDiibeCdw==',key_name='tempest-keypair-402581287',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:42:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='09b9ad4975bb43fdbb94dd2742b3d590',ramdisk_id='',reservation_id='r-9o0hp8jg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-803710656',owner_user_name='tempest-VolumesSnapshotTestJSON-803710656-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:42:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f78829a85087437da8edf53a02ae7358',uuid=34956fa9-e329-4681-8e37-1bb18def29cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converting VIF {"id": "add0526b-29b8-4df4-b358-c5e79142a734", "address": "fa:16:3e:7c:ab:38", "network": {"id": "02b7f956-2309-4a06-aecc-971b709d5b4e", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1167292215-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "09b9ad4975bb43fdbb94dd2742b3d590", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapadd0526b-29", "ovs_interfaceid": "add0526b-29b8-4df4-b358-c5e79142a734", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ab:38,bridge_name='br-int',has_traffic_filtering=True,id=add0526b-29b8-4df4-b358-c5e79142a734,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd0526b-29') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG os_vif [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ab:38,bridge_name='br-int',has_traffic_filtering=True,id=add0526b-29b8-4df4-b358-c5e79142a734,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd0526b-29') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapadd0526b-29, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4e10d2d7-33b9-4249-8637-d359a0cad2c6) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:46:10 user nova-compute[75102]: INFO os_vif [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7c:ab:38,bridge_name='br-int',has_traffic_filtering=True,id=add0526b-29b8-4df4-b358-c5e79142a734,network=Network(02b7f956-2309-4a06-aecc-971b709d5b4e),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapadd0526b-29')
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CWjMorRD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:46:10 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[734f62ae-3bdc-48ec-85e9-34b5c2e26b53]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:46:10 user nova-compute[75102]: No targets found.
Nov 10 16:46:10 user nova-compute[75102]: iSNS:
Nov 10 16:46:10 user nova-compute[75102]: No targets found.
Nov 10 16:46:10 user nova-compute[75102]: STATIC:
Nov 10 16:46:10 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35
Nov 10 16:46:10 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:46:10 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:46:10 user nova-compute[75102]: FIRMWARE:
Nov 10 16:46:10 user nova-compute[75102]: No targets found.
Nov 10 16:46:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:46:10 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:46:10 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:8d51e82d-55c1-4b53-902a-2e8522f34a63', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:46:10 user nova-compute[75102]: INFO nova.compute.claims [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Claim successful on node user
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b902d770-ff12-47fc-ad6e-d4fdc5b8a084]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[16723c56-8d15-4359-beb9-08ee527f99dc]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:46:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:46:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f745844c0>, {}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Disconnecting from: [] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] <== disconnect_volume: return (76ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:46:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Deleting instance files /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb_del
Nov 10 16:46:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Deletion of /opt/stack/data/nova/instances/34956fa9-e329-4681-8e37-1bb18def29cb_del complete
Nov 10 16:46:10 user nova-compute[75102]: INFO nova.compute.manager [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.287s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.network.neutron [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:46:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.policy [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd7ddbca327e4e2893563e02cd3d3754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea704446109948239b67b37c01c2c146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:46:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Creating image(s)
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:46:10 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Took 0.79 seconds to deallocate network for instance.
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-b12acb09-3286-42dc-93a5-a6113b0937f5 req-33a8432e-5984-49f5-9750-36801d62b4c3 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Received event network-vif-deleted-add0526b-29b8-4df4-b358-c5e79142a734 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:10 user nova-compute[75102]: INFO nova.compute.manager [req-b12acb09-3286-42dc-93a5-a6113b0937f5 req-33a8432e-5984-49f5-9750-36801d62b4c3 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Neutron deleted interface add0526b-29b8-4df4-b358-c5e79142a734; detaching it from the instance and deleting it from the info cache
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-b12acb09-3286-42dc-93a5-a6113b0937f5 req-33a8432e-5984-49f5-9750-36801d62b4c3 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:46:10 user nova-compute[75102]: WARNING nova.volume.cinder [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Attachment c40e5002-cefe-4c12-8e71-8002d0707a39 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = c40e5002-cefe-4c12-8e71-8002d0707a39. (HTTP 404) (Request-ID: req-dd0a51cf-42b0-4ae0-884e-c2bf15970cc0)
Nov 10 16:46:10 user nova-compute[75102]: INFO nova.compute.manager [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Took 0.03 seconds to detach 1 volumes for instance.
Nov 10 16:46:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-b12acb09-3286-42dc-93a5-a6113b0937f5 req-33a8432e-5984-49f5-9750-36801d62b4c3 service nova] [instance: 34956fa9-e329-4681-8e37-1bb18def29cb] Detach interface failed, port_id=add0526b-29b8-4df4-b358-c5e79142a734, reason: Instance 34956fa9-e329-4681-8e37-1bb18def29cb could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk 1073741824" returned: 0 in 0.057s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.266s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Successfully created port: 000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.342s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.082s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:46:11 user nova-compute[75102]: INFO nova.compute.claims [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Claim successful on node user
Nov 10 16:46:11 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Deleted allocations for instance 34956fa9-e329-4681-8e37-1bb18def29cb
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Cannot resize image /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Ensure instance console log exists: /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3302607e-f3dc-486f-8154-30958ca764c9 tempest-VolumesSnapshotTestJSON-803710656 tempest-VolumesSnapshotTestJSON-803710656-project-member] Lock "34956fa9-e329-4681-8e37-1bb18def29cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.331s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.318s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:46:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.policy [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd7ddbca327e4e2893563e02cd3d3754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea704446109948239b67b37c01c2c146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:46:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Creating image(s)
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:11 user nova-compute[75102]: DEBUG nova.network.neutron [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Successfully updated port: 000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquired lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-56999b1f-9a5d-4f33-a124-f1eb230ae68a req-ea14c275-f0c6-4d19-8b83-d866f620cd36 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-changed-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-56999b1f-9a5d-4f33-a124-f1eb230ae68a req-ea14c275-f0c6-4d19-8b83-d866f620cd36 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Refreshing instance network info cache due to event network-changed-000d56c3-206f-46d9-a7a3-550d2b5a947e. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-56999b1f-9a5d-4f33-a124-f1eb230ae68a req-ea14c275-f0c6-4d19-8b83-d866f620cd36 service nova] Acquiring lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.216s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.232s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk 1073741824" returned: 0 in 0.061s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.298s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Releasing lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Instance network_info: |[{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-56999b1f-9a5d-4f33-a124-f1eb230ae68a req-ea14c275-f0c6-4d19-8b83-d866f620cd36 service nova] Acquired lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-56999b1f-9a5d-4f33-a124-f1eb230ae68a req-ea14c275-f0c6-4d19-8b83-d866f620cd36 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Refreshing network info cache for port 000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Start _get_guest_xml network_info=[{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:46:12 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:46:12 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-813594258',display_name='tempest-ServerRescueNegativeTestJSON-server-813594258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-813594258',id=46,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-p0gvaucu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:46:11Z,user_data=None,user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=fcd9ad66-cdd7-4016-9204-d2b0f40a1718,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:bb,bridge_name='br-int',has_traffic_filtering=True,id=000d56c3-206f-46d9-a7a3-550d2b5a947e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap000d56c3-20') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.objects.instance [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'pci_devices' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.neutron [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Successfully created port: e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:46:12 user nova-compute[75102]:   <uuid>fcd9ad66-cdd7-4016-9204-d2b0f40a1718</uuid>
Nov 10 16:46:12 user nova-compute[75102]:   <name>instance-0000002e</name>
Nov 10 16:46:12 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:46:12 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:46:12 user nova-compute[75102]:   <metadata>
Nov 10 16:46:12 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:46:12 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:46:12 user nova-compute[75102]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-813594258</nova:name>
Nov 10 16:46:12 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:46:12</nova:creationTime>
Nov 10 16:46:12 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:46:12 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:46:12 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:46:12 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:46:12 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:46:12 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:46:12 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:46:12 user nova-compute[75102]:       <nova:owner>
Nov 10 16:46:12 user nova-compute[75102]:         <nova:user uuid="cd7ddbca327e4e2893563e02cd3d3754">tempest-ServerRescueNegativeTestJSON-662150154-project-member</nova:user>
Nov 10 16:46:12 user nova-compute[75102]:         <nova:project uuid="ea704446109948239b67b37c01c2c146">tempest-ServerRescueNegativeTestJSON-662150154</nova:project>
Nov 10 16:46:12 user nova-compute[75102]:       </nova:owner>
Nov 10 16:46:12 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:46:12 user nova-compute[75102]:       <nova:ports>
Nov 10 16:46:12 user nova-compute[75102]:         <nova:port uuid="000d56c3-206f-46d9-a7a3-550d2b5a947e">
Nov 10 16:46:12 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 16:46:12 user nova-compute[75102]:         </nova:port>
Nov 10 16:46:12 user nova-compute[75102]:       </nova:ports>
Nov 10 16:46:12 user nova-compute[75102]:     </nova:instance>
Nov 10 16:46:12 user nova-compute[75102]:   </metadata>
Nov 10 16:46:12 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:46:12 user nova-compute[75102]:     <system>
Nov 10 16:46:12 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:46:12 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:46:12 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:46:12 user nova-compute[75102]:       <entry name="serial">fcd9ad66-cdd7-4016-9204-d2b0f40a1718</entry>
Nov 10 16:46:12 user nova-compute[75102]:       <entry name="uuid">fcd9ad66-cdd7-4016-9204-d2b0f40a1718</entry>
Nov 10 16:46:12 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:46:12 user nova-compute[75102]:     </system>
Nov 10 16:46:12 user nova-compute[75102]:   </sysinfo>
Nov 10 16:46:12 user nova-compute[75102]:   <os>
Nov 10 16:46:12 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:46:12 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:46:12 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:46:12 user nova-compute[75102]:   </os>
Nov 10 16:46:12 user nova-compute[75102]:   <features>
Nov 10 16:46:12 user nova-compute[75102]:     <acpi/>
Nov 10 16:46:12 user nova-compute[75102]:     <apic/>
Nov 10 16:46:12 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:46:12 user nova-compute[75102]:   </features>
Nov 10 16:46:12 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:46:12 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:46:12 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:46:12 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:46:12 user nova-compute[75102]:   </clock>
Nov 10 16:46:12 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:46:12 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:46:12 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:46:12 user nova-compute[75102]:   </cpu>
Nov 10 16:46:12 user nova-compute[75102]:   <devices>
Nov 10 16:46:12 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:46:12 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:46:12 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk"/>
Nov 10 16:46:12 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:46:12 user nova-compute[75102]:     </disk>
Nov 10 16:46:12 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:46:12 user nova-compute[75102]:       <mac address="fa:16:3e:6a:7c:bb"/>
Nov 10 16:46:12 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:46:12 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:46:12 user nova-compute[75102]:       <target dev="tap000d56c3-20"/>
Nov 10 16:46:12 user nova-compute[75102]:     </interface>
Nov 10 16:46:12 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:46:12 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/console.log" append="off"/>
Nov 10 16:46:12 user nova-compute[75102]:     </serial>
Nov 10 16:46:12 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:46:12 user nova-compute[75102]:     <video>
Nov 10 16:46:12 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:46:12 user nova-compute[75102]:     </video>
Nov 10 16:46:12 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:46:12 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:46:12 user nova-compute[75102]:     </rng>
Nov 10 16:46:12 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:46:12 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:46:12 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:46:12 user nova-compute[75102]:     </memballoon>
Nov 10 16:46:12 user nova-compute[75102]:   </devices>
Nov 10 16:46:12 user nova-compute[75102]: </domain>
Nov 10 16:46:12 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-813594258',display_name='tempest-ServerRescueNegativeTestJSON-server-813594258',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-813594258',id=46,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-p0gvaucu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:46:11Z,user_data=None,user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=fcd9ad66-cdd7-4016-9204-d2b0f40a1718,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:bb,bridge_name='br-int',has_traffic_filtering=True,id=000d56c3-206f-46d9-a7a3-550d2b5a947e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap000d56c3-20') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG os_vif [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:bb,bridge_name='br-int',has_traffic_filtering=True,id=000d56c3-206f-46d9-a7a3-550d2b5a947e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap000d56c3-20') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '51ad9f68-a3dc-5b32-82fb-0314c229e2c7', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap000d56c3-20, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap000d56c3-20, col_values=(('qos', UUID('48b3706d-53d5-4948-8f14-a109d73eb231')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap000d56c3-20, col_values=(('external_ids', {'iface-id': '000d56c3-206f-46d9-a7a3-550d2b5a947e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:7c:bb', 'vm-uuid': 'fcd9ad66-cdd7-4016-9204-d2b0f40a1718'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:12 user nova-compute[75102]: INFO os_vif [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:7c:bb,bridge_name='br-int',has_traffic_filtering=True,id=000d56c3-206f-46d9-a7a3-550d2b5a947e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap000d56c3-20')
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No VIF found with MAC fa:16:3e:6a:7c:bb, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Cannot resize image /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Ensure instance console log exists: /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-56999b1f-9a5d-4f33-a124-f1eb230ae68a req-ea14c275-f0c6-4d19-8b83-d866f620cd36 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updated VIF entry in instance network info cache for port 000d56c3-206f-46d9-a7a3-550d2b5a947e. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:46:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-56999b1f-9a5d-4f33-a124-f1eb230ae68a req-ea14c275-f0c6-4d19-8b83-d866f620cd36 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-56999b1f-9a5d-4f33-a124-f1eb230ae68a req-ea14c275-f0c6-4d19-8b83-d866f620cd36 service nova] Releasing lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.network.neutron [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Successfully updated port: e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquired lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.network.neutron [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-ed339d8e-a707-4c9e-ad2d-897eb5ba74d0 req-5b149833-7cec-41e4-bf8a-222972fe8553 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-changed-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-ed339d8e-a707-4c9e-ad2d-897eb5ba74d0 req-5b149833-7cec-41e4-bf8a-222972fe8553 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Refreshing instance network info cache due to event network-changed-e902d3a4-bca2-4364-aad8-a4fb12d69d31. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ed339d8e-a707-4c9e-ad2d-897eb5ba74d0 req-5b149833-7cec-41e4-bf8a-222972fe8553 service nova] Acquiring lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.network.neutron [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:13 user nova-compute[75102]: INFO nova.compute.manager [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Terminating instance
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.network.neutron [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updating instance_info_cache with network_info: [{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Releasing lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Instance network_info: |[{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ed339d8e-a707-4c9e-ad2d-897eb5ba74d0 req-5b149833-7cec-41e4-bf8a-222972fe8553 service nova] Acquired lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-ed339d8e-a707-4c9e-ad2d-897eb5ba74d0 req-5b149833-7cec-41e4-bf8a-222972fe8553 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Refreshing network info cache for port e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Start _get_guest_xml network_info=[{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:46:13 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:46:13 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1143453276',display_name='tempest-ServerRescueNegativeTestJSON-server-1143453276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1143453276',id=47,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-d8hc0fdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:46:12Z,user_data=None,user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=d70f5eeb-42bd-4612-8103-9e5bc8950cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:5a:30,bridge_name='br-int',has_traffic_filtering=True,id=e902d3a4-bca2-4364-aad8-a4fb12d69d31,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape902d3a4-bc') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.objects.instance [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'pci_devices' on Instance uuid d70f5eeb-42bd-4612-8103-9e5bc8950cea {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:46:13 user nova-compute[75102]:   <uuid>d70f5eeb-42bd-4612-8103-9e5bc8950cea</uuid>
Nov 10 16:46:13 user nova-compute[75102]:   <name>instance-0000002f</name>
Nov 10 16:46:13 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:46:13 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:46:13 user nova-compute[75102]:   <metadata>
Nov 10 16:46:13 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:46:13 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:46:13 user nova-compute[75102]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1143453276</nova:name>
Nov 10 16:46:13 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:46:13</nova:creationTime>
Nov 10 16:46:13 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:46:13 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:46:13 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:46:13 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:46:13 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:46:13 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:46:13 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:46:13 user nova-compute[75102]:       <nova:owner>
Nov 10 16:46:13 user nova-compute[75102]:         <nova:user uuid="cd7ddbca327e4e2893563e02cd3d3754">tempest-ServerRescueNegativeTestJSON-662150154-project-member</nova:user>
Nov 10 16:46:13 user nova-compute[75102]:         <nova:project uuid="ea704446109948239b67b37c01c2c146">tempest-ServerRescueNegativeTestJSON-662150154</nova:project>
Nov 10 16:46:13 user nova-compute[75102]:       </nova:owner>
Nov 10 16:46:13 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:46:13 user nova-compute[75102]:       <nova:ports>
Nov 10 16:46:13 user nova-compute[75102]:         <nova:port uuid="e902d3a4-bca2-4364-aad8-a4fb12d69d31">
Nov 10 16:46:13 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 16:46:13 user nova-compute[75102]:         </nova:port>
Nov 10 16:46:13 user nova-compute[75102]:       </nova:ports>
Nov 10 16:46:13 user nova-compute[75102]:     </nova:instance>
Nov 10 16:46:13 user nova-compute[75102]:   </metadata>
Nov 10 16:46:13 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:46:13 user nova-compute[75102]:     <system>
Nov 10 16:46:13 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:46:13 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:46:13 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:46:13 user nova-compute[75102]:       <entry name="serial">d70f5eeb-42bd-4612-8103-9e5bc8950cea</entry>
Nov 10 16:46:13 user nova-compute[75102]:       <entry name="uuid">d70f5eeb-42bd-4612-8103-9e5bc8950cea</entry>
Nov 10 16:46:13 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:46:13 user nova-compute[75102]:     </system>
Nov 10 16:46:13 user nova-compute[75102]:   </sysinfo>
Nov 10 16:46:13 user nova-compute[75102]:   <os>
Nov 10 16:46:13 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:46:13 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:46:13 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:46:13 user nova-compute[75102]:   </os>
Nov 10 16:46:13 user nova-compute[75102]:   <features>
Nov 10 16:46:13 user nova-compute[75102]:     <acpi/>
Nov 10 16:46:13 user nova-compute[75102]:     <apic/>
Nov 10 16:46:13 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:46:13 user nova-compute[75102]:   </features>
Nov 10 16:46:13 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:46:13 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:46:13 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:46:13 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:46:13 user nova-compute[75102]:   </clock>
Nov 10 16:46:13 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:46:13 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:46:13 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:46:13 user nova-compute[75102]:   </cpu>
Nov 10 16:46:13 user nova-compute[75102]:   <devices>
Nov 10 16:46:13 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:46:13 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:46:13 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk"/>
Nov 10 16:46:13 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:46:13 user nova-compute[75102]:     </disk>
Nov 10 16:46:13 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:46:13 user nova-compute[75102]:       <mac address="fa:16:3e:15:5a:30"/>
Nov 10 16:46:13 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:46:13 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:46:13 user nova-compute[75102]:       <target dev="tape902d3a4-bc"/>
Nov 10 16:46:13 user nova-compute[75102]:     </interface>
Nov 10 16:46:13 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:46:13 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/console.log" append="off"/>
Nov 10 16:46:13 user nova-compute[75102]:     </serial>
Nov 10 16:46:13 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:46:13 user nova-compute[75102]:     <video>
Nov 10 16:46:13 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:46:13 user nova-compute[75102]:     </video>
Nov 10 16:46:13 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:46:13 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:46:13 user nova-compute[75102]:     </rng>
Nov 10 16:46:13 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:46:13 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:46:13 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:46:13 user nova-compute[75102]:     </memballoon>
Nov 10 16:46:13 user nova-compute[75102]:   </devices>
Nov 10 16:46:13 user nova-compute[75102]: </domain>
Nov 10 16:46:13 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1143453276',display_name='tempest-ServerRescueNegativeTestJSON-server-1143453276',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1143453276',id=47,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-d8hc0fdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:46:12Z,user_data=None,user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=d70f5eeb-42bd-4612-8103-9e5bc8950cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:5a:30,bridge_name='br-int',has_traffic_filtering=True,id=e902d3a4-bca2-4364-aad8-a4fb12d69d31,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape902d3a4-bc') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG os_vif [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:5a:30,bridge_name='br-int',has_traffic_filtering=True,id=e902d3a4-bca2-4364-aad8-a4fb12d69d31,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape902d3a4-bc') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2afbe773-a5c3-5071-ba23-7139bfe98aeb', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape902d3a4-bc, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape902d3a4-bc, col_values=(('qos', UUID('2e4c62d6-18d3-4dfa-abe9-086acf89cbef')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape902d3a4-bc, col_values=(('external_ids', {'iface-id': 'e902d3a4-bca2-4364-aad8-a4fb12d69d31', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:5a:30', 'vm-uuid': 'd70f5eeb-42bd-4612-8103-9e5bc8950cea'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:46:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:13 user nova-compute[75102]: INFO os_vif [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:5a:30,bridge_name='br-int',has_traffic_filtering=True,id=e902d3a4-bca2-4364-aad8-a4fb12d69d31,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape902d3a4-bc')
Nov 10 16:46:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No VIF found with MAC fa:16:3e:15:5a:30, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-3183f088-a35f-4af9-88bc-25e79c1331d1 req-dcc1fdf3-14d4-4251-a4e5-c35046c8a0e5 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received event network-vif-unplugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3183f088-a35f-4af9-88bc-25e79c1331d1 req-dcc1fdf3-14d4-4251-a4e5-c35046c8a0e5 service nova] Acquiring lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3183f088-a35f-4af9-88bc-25e79c1331d1 req-dcc1fdf3-14d4-4251-a4e5-c35046c8a0e5 service nova] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3183f088-a35f-4af9-88bc-25e79c1331d1 req-dcc1fdf3-14d4-4251-a4e5-c35046c8a0e5 service nova] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-3183f088-a35f-4af9-88bc-25e79c1331d1 req-dcc1fdf3-14d4-4251-a4e5-c35046c8a0e5 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] No waiting events found dispatching network-vif-unplugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-3183f088-a35f-4af9-88bc-25e79c1331d1 req-dcc1fdf3-14d4-4251-a4e5-c35046c8a0e5 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received event network-vif-unplugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG nova.network.neutron [req-ed339d8e-a707-4c9e-ad2d-897eb5ba74d0 req-5b149833-7cec-41e4-bf8a-222972fe8553 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updated VIF entry in instance network info cache for port e902d3a4-bca2-4364-aad8-a4fb12d69d31. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG nova.network.neutron [req-ed339d8e-a707-4c9e-ad2d-897eb5ba74d0 req-5b149833-7cec-41e4-bf8a-222972fe8553 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updating instance_info_cache with network_info: [{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ed339d8e-a707-4c9e-ad2d-897eb5ba74d0 req-5b149833-7cec-41e4-bf8a-222972fe8553 service nova] Releasing lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Instance destroyed successfully.
Nov 10 16:46:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'resources' on Instance uuid 2237c70c-96db-4b53-98a4-24ae8d0c3abe {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:41:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1929673096',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1929673096',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1929673096',id=41,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOOD8ebqs7aaPdEvf/DGH76J9LCL7eZL5DDNqLRYwQD6kYoCiojMOTRjKyKaucofMTl5gjjikxeZrnr7ZCBoRMg2PIDwfGSgWEhLC1eeln6Mix/5YgaDff0bap2AiCokXQ==',key_name='tempest-keypair-511649803',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:41:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-63olmeo0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:41:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='e96544e5daa74d51a232f565129b328a',uuid=2237c70c-96db-4b53-98a4-24ae8d0c3abe,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "address": "fa:16:3e:44:26:56", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.39", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap9228e58f-cb", "ovs_interfaceid": "9228e58f-cb9e-4beb-83e3-c1e8460afb0c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:44:26:56,bridge_name='br-int',has_traffic_filtering=True,id=9228e58f-cb9e-4beb-83e3-c1e8460afb0c,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9228e58f-cb') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_vif [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:26:56,bridge_name='br-int',has_traffic_filtering=True,id=9228e58f-cb9e-4beb-83e3-c1e8460afb0c,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9228e58f-cb') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9228e58f-cb, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3a4650ce-a2b0-494c-b4a1-3ee5dad3339a) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:15 user nova-compute[75102]: INFO os_vif [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:44:26:56,bridge_name='br-int',has_traffic_filtering=True,id=9228e58f-cb9e-4beb-83e3-c1e8460afb0c,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9228e58f-cb')
Nov 10 16:46:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IkJzYZqv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:46:15 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f59f2c-9834-4016-8352-595118d3b150]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:46:15 user nova-compute[75102]: No targets found.
Nov 10 16:46:15 user nova-compute[75102]: iSNS:
Nov 10 16:46:15 user nova-compute[75102]: No targets found.
Nov 10 16:46:15 user nova-compute[75102]: STATIC:
Nov 10 16:46:15 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35
Nov 10 16:46:15 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:46:15 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:46:15 user nova-compute[75102]: FIRMWARE:
Nov 10 16:46:15 user nova-compute[75102]: No targets found.
Nov 10 16:46:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:46:15 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:46:15 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab3c6579-7f42-4862-a57e-08931977046f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64eb3ca-e358-4401-9407-fdc0f5f6c48d]: (4, ('tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:46:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 (non-flash)
Nov 10 16:46:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f746041f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[83df1f0e-8d84-420e-a828-30b97e1cf7fc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2903696-74bb-40fa-ac81-6565dbe9e317]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7428ed48-087d-4bf4-a941-742ba2ff5956]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[154bda4f-8123-484e-84b2-dff364e14b2c]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c35ba4-2bcb-464f-9a3c-d10212cff769]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --logout" returned: 0 in 0.166s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[82bcd288-3812-4466-8ccb-3afec13522c6]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35, portal: 172.16.0.220,3260]
Nov 10 16:46:15 user nova-compute[75102]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35, portal: 172.16.0.220,3260] successful.
Nov 10 16:46:15 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bcabe3-01bd-4d5f-b0d2-88b89f8a1370]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== disconnect_volume: return (421ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:46:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Deleting instance files /opt/stack/data/nova/instances/2237c70c-96db-4b53-98a4-24ae8d0c3abe_del
Nov 10 16:46:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Deletion of /opt/stack/data/nova/instances/2237c70c-96db-4b53-98a4-24ae8d0c3abe_del complete
Nov 10 16:46:15 user nova-compute[75102]: INFO nova.compute.manager [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Took 2.12 seconds to destroy the instance on the hypervisor.
Nov 10 16:46:15 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received event network-vif-plugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] Acquiring lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] No waiting events found dispatching network-vif-plugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:46:16 user nova-compute[75102]: WARNING nova.compute.manager [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received unexpected event network-vif-plugged-9228e58f-cb9e-4beb-83e3-c1e8460afb0c for instance with vm_state active and task_state deleting.
Nov 10 16:46:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:46:16 user nova-compute[75102]: WARNING nova.compute.manager [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state building and task_state spawning.
Nov 10 16:46:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:46:16 user nova-compute[75102]: WARNING nova.compute.manager [req-d4677c6e-96a0-4506-a751-53dae34e0944 req-5b7fc8d7-783c-48e4-8b4d-2cf7299f3640 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state building and task_state spawning.
Nov 10 16:46:16 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:46:16 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Took 0.67 seconds to deallocate network for instance.
Nov 10 16:46:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-6a267a77-f3dc-46ae-80b3-8c1137fe51d0 req-4f7edbbb-66f7-4c64-a3c2-d0e6308800e1 service nova] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Received event network-vif-deleted-9228e58f-cb9e-4beb-83e3-c1e8460afb0c {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.261s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:17 user nova-compute[75102]: INFO nova.compute.manager [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Took 1.41 seconds to detach 1 volumes for instance.
Nov 10 16:46:17 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 2237c70c-96db-4b53-98a4-24ae8d0c3abe] Deleting volume: 37c2b0fa-9eac-40e2-8feb-f42ca3ee4e35 {{(pid=75102) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.007s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:46:18 user nova-compute[75102]: WARNING nova.compute.manager [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state building and task_state spawning.
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:46:18 user nova-compute[75102]: WARNING nova.compute.manager [req-afbcfc47-d691-4213-b538-2402c3b17252 req-510b29a1-6967-4f73-929f-bb6cddd17071 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state building and task_state spawning.
Nov 10 16:46:18 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:46:18 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8605MB free_disk=25.148849487304688GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:46:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Instance spawned successfully.
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.651s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.023s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Deleted allocations for instance 2237c70c-96db-4b53-98a4-24ae8d0c3abe
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:46:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Instance spawned successfully.
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:46:18 user nova-compute[75102]: INFO nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Took 8.01 seconds to spawn the instance on the hypervisor.
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0bd78e9-e180-4150-af54-53cb1cea782f tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "2237c70c-96db-4b53-98a4-24ae8d0c3abe" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 5.167s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:18 user nova-compute[75102]: INFO nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Took 6.80 seconds to spawn the instance on the hypervisor.
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:46:18 user nova-compute[75102]: INFO nova.compute.manager [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Took 8.71 seconds to build instance.
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-45523972-dba1-4681-bdeb-86bff1019627 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.818s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:46:18 user nova-compute[75102]: INFO nova.compute.manager [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Took 7.54 seconds to build instance.
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47f11865-9418-4bc5-8a77-f6cd0e4111ab tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.630s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:46:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.317s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:46:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:46:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 16:46:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:20 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:46:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:46:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:01 user nova-compute[75102]: INFO nova.compute.manager [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Unshelving
Nov 10 16:47:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'pci_requests' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:47:02 user nova-compute[75102]: INFO nova.compute.claims [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Claim successful on node user
Nov 10 16:47:02 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:02 user nova-compute[75102]: INFO nova.network.neutron [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updating port 2a7fa843-15f0-4f13-b376-9a42119762a9 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquired lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-99ffd577-8b84-4690-9e37-1eb316c32edb req-4fe6c85d-33a8-4f14-8601-180f47c1b13f service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-changed-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-99ffd577-8b84-4690-9e37-1eb316c32edb req-4fe6c85d-33a8-4f14-8601-180f47c1b13f service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Refreshing instance network info cache due to event network-changed-2a7fa843-15f0-4f13-b376-9a42119762a9. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:47:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-99ffd577-8b84-4690-9e37-1eb316c32edb req-4fe6c85d-33a8-4f14-8601-180f47c1b13f service nova] Acquiring lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG nova.network.neutron [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updating instance_info_cache with network_info: [{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Releasing lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:47:03 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Creating image(s)
Nov 10 16:47:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-99ffd577-8b84-4690-9e37-1eb316c32edb req-4fe6c85d-33a8-4f14-8601-180f47c1b13f service nova] Acquired lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG nova.network.neutron [req-99ffd577-8b84-4690-9e37-1eb316c32edb req-4fe6c85d-33a8-4f14-8601-180f47c1b13f service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Refreshing network info cache for port 2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG nova.objects.base [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Object Instance<8ca14a6f-0eb8-42e4-a062-ea94d3e771e5> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "4dcff73873cf61711474c0cb3e8ec55fc028c4d1" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "4dcff73873cf61711474c0cb3e8ec55fc028c4d1" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1.part --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1.part --force-share --output=json" returned: 0 in 0.200s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG nova.virt.images [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] cc3bbcdb-24a1-4d0a-b31a-9b2e8b3f64bb was qcow2, converting to raw {{(pid=75102) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG nova.privsep.utils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75102) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1.part /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1.converted {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG nova.network.neutron [req-99ffd577-8b84-4690-9e37-1eb316c32edb req-4fe6c85d-33a8-4f14-8601-180f47c1b13f service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updated VIF entry in instance network info cache for port 2a7fa843-15f0-4f13-b376-9a42119762a9. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG nova.network.neutron [req-99ffd577-8b84-4690-9e37-1eb316c32edb req-4fe6c85d-33a8-4f14-8601-180f47c1b13f service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updating instance_info_cache with network_info: [{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-99ffd577-8b84-4690-9e37-1eb316c32edb req-4fe6c85d-33a8-4f14-8601-180f47c1b13f service nova] Releasing lock "refresh_cache-8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1.part /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1.converted" returned: 0 in 0.700s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:05 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1.converted --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1.converted --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "4dcff73873cf61711474c0cb3e8ec55fc028c4d1" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.502s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1 --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "4dcff73873cf61711474c0cb3e8ec55fc028c4d1" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "4dcff73873cf61711474c0cb3e8ec55fc028c4d1" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1 --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1,backing_fmt=raw /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1,backing_fmt=raw /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk 1073741824" returned: 0 in 0.059s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "4dcff73873cf61711474c0cb3e8ec55fc028c4d1" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1 --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1 --force-share --output=json" returned: 0 in 0.208s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'migration_context' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:47:06 user nova-compute[75102]: DEBUG nova.objects.base [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Object Instance<8ca14a6f-0eb8-42e4-a062-ea94d3e771e5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:47:06 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Rebasing disk image.
Nov 10 16:47:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb -F raw /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb -F raw /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk" returned: 0 in 2.670s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Ensure instance console log exists: /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Start _get_guest_xml network_info=[{"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8ce64b7fb099ecc0aacc536f0933a2d',container_format='bare',created_at=2023-11-10T16:45:09Z,direct_url=<?>,disk_format='qcow2',id=cc3bbcdb-24a1-4d0a-b31a-9b2e8b3f64bb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-800447560-shelved',owner='b656df48b2114d27a9bf9fe6df81037f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T16:45:14Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:47:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:47:09 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8ce64b7fb099ecc0aacc536f0933a2d',container_format='bare',created_at=2023-11-10T16:45:09Z,direct_url=<?>,disk_format='qcow2',id=cc3bbcdb-24a1-4d0a-b31a-9b2e8b3f64bb,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-800447560-shelved',owner='b656df48b2114d27a9bf9fe6df81037f',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-10T16:45:14Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.objects.base [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Object Instance<8ca14a6f-0eb8-42e4-a062-ea94d3e771e5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-800447560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-800447560',id=43,image_ref='cc3bbcdb-24a1-4d0a-b31a-9b2e8b3f64bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-287893862',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:43:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b656df48b2114d27a9bf9fe6df81037f',ramdisk_id='',reservation_id='r-pejfuw9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1377452369',owner_user_name='tempest-AttachVolumeShelveTestJSON-1377452369-project-member',shelved_at='2023-11-10T16:45:13.727974',shelved_host='user',shelved_image_id='cc3bbcdb-24a1-4d0a-b31a-9b2e8b3f64bb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50787ee821e0400eb445fe8cd891e119',uuid=8ca14a6f-0eb8-42e4-a062-ea94d3e771e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converting VIF {"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.objects.base [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Object Instance<8ca14a6f-0eb8-42e4-a062-ea94d3e771e5> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:47:09 user nova-compute[75102]:   <uuid>8ca14a6f-0eb8-42e4-a062-ea94d3e771e5</uuid>
Nov 10 16:47:09 user nova-compute[75102]:   <name>instance-0000002b</name>
Nov 10 16:47:09 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:47:09 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:47:09 user nova-compute[75102]:   <metadata>
Nov 10 16:47:09 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:47:09 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:47:09 user nova-compute[75102]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-800447560</nova:name>
Nov 10 16:47:09 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:47:09</nova:creationTime>
Nov 10 16:47:09 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:47:09 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:47:09 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:47:09 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:47:09 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:47:09 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:47:09 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:47:09 user nova-compute[75102]:       <nova:owner>
Nov 10 16:47:09 user nova-compute[75102]:         <nova:user uuid="50787ee821e0400eb445fe8cd891e119">tempest-AttachVolumeShelveTestJSON-1377452369-project-member</nova:user>
Nov 10 16:47:09 user nova-compute[75102]:         <nova:project uuid="b656df48b2114d27a9bf9fe6df81037f">tempest-AttachVolumeShelveTestJSON-1377452369</nova:project>
Nov 10 16:47:09 user nova-compute[75102]:       </nova:owner>
Nov 10 16:47:09 user nova-compute[75102]:       <nova:root type="image" uuid="cc3bbcdb-24a1-4d0a-b31a-9b2e8b3f64bb"/>
Nov 10 16:47:09 user nova-compute[75102]:       <nova:ports>
Nov 10 16:47:09 user nova-compute[75102]:         <nova:port uuid="2a7fa843-15f0-4f13-b376-9a42119762a9">
Nov 10 16:47:09 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 10 16:47:09 user nova-compute[75102]:         </nova:port>
Nov 10 16:47:09 user nova-compute[75102]:       </nova:ports>
Nov 10 16:47:09 user nova-compute[75102]:     </nova:instance>
Nov 10 16:47:09 user nova-compute[75102]:   </metadata>
Nov 10 16:47:09 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:47:09 user nova-compute[75102]:     <system>
Nov 10 16:47:09 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:47:09 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:47:09 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:47:09 user nova-compute[75102]:       <entry name="serial">8ca14a6f-0eb8-42e4-a062-ea94d3e771e5</entry>
Nov 10 16:47:09 user nova-compute[75102]:       <entry name="uuid">8ca14a6f-0eb8-42e4-a062-ea94d3e771e5</entry>
Nov 10 16:47:09 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:47:09 user nova-compute[75102]:     </system>
Nov 10 16:47:09 user nova-compute[75102]:   </sysinfo>
Nov 10 16:47:09 user nova-compute[75102]:   <os>
Nov 10 16:47:09 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:47:09 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:47:09 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:47:09 user nova-compute[75102]:   </os>
Nov 10 16:47:09 user nova-compute[75102]:   <features>
Nov 10 16:47:09 user nova-compute[75102]:     <acpi/>
Nov 10 16:47:09 user nova-compute[75102]:     <apic/>
Nov 10 16:47:09 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:47:09 user nova-compute[75102]:   </features>
Nov 10 16:47:09 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:47:09 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:47:09 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:47:09 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:47:09 user nova-compute[75102]:   </clock>
Nov 10 16:47:09 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:47:09 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:47:09 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:47:09 user nova-compute[75102]:   </cpu>
Nov 10 16:47:09 user nova-compute[75102]:   <devices>
Nov 10 16:47:09 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:47:09 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:47:09 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk"/>
Nov 10 16:47:09 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:47:09 user nova-compute[75102]:     </disk>
Nov 10 16:47:09 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:47:09 user nova-compute[75102]:       <mac address="fa:16:3e:da:ba:32"/>
Nov 10 16:47:09 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:47:09 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:47:09 user nova-compute[75102]:       <target dev="tap2a7fa843-15"/>
Nov 10 16:47:09 user nova-compute[75102]:     </interface>
Nov 10 16:47:09 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:47:09 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/console.log" append="off"/>
Nov 10 16:47:09 user nova-compute[75102]:     </serial>
Nov 10 16:47:09 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:47:09 user nova-compute[75102]:     <video>
Nov 10 16:47:09 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:47:09 user nova-compute[75102]:     </video>
Nov 10 16:47:09 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:47:09 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:47:09 user nova-compute[75102]:     </rng>
Nov 10 16:47:09 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:47:09 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:47:09 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:47:09 user nova-compute[75102]:     </memballoon>
Nov 10 16:47:09 user nova-compute[75102]:   </devices>
Nov 10 16:47:09 user nova-compute[75102]: </domain>
Nov 10 16:47:09 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-800447560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-800447560',id=43,image_ref='cc3bbcdb-24a1-4d0a-b31a-9b2e8b3f64bb',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-287893862',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:43:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='b656df48b2114d27a9bf9fe6df81037f',ramdisk_id='',reservation_id='r-pejfuw9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1377452369',owner_user_name='tempest-AttachVolumeShelveTestJSON-1377452369-project-member',shelved_at='2023-11-10T16:45:13.727974',shelved_host='user',shelved_image_id='cc3bbcdb-24a1-4d0a-b31a-9b2e8b3f64bb'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:47:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50787ee821e0400eb445fe8cd891e119',uuid=8ca14a6f-0eb8-42e4-a062-ea94d3e771e5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converting VIF {"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG os_vif [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '25c1557a-c606-5e1f-ab81-3d12d1f03bbf', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a7fa843-15, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a7fa843-15, col_values=(('qos', UUID('2ed6de09-ed05-4a9c-92cd-dd91b7a5ad4e')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a7fa843-15, col_values=(('external_ids', {'iface-id': '2a7fa843-15f0-4f13-b376-9a42119762a9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:ba:32', 'vm-uuid': '8ca14a6f-0eb8-42e4-a062-ea94d3e771e5'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:09 user nova-compute[75102]: INFO os_vif [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15')
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:47:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] No VIF found with MAC fa:16:3e:da:ba:32, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:47:10 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-616dfc05-e834-46d4-827f-47afca6e2bae req-5c0df29f-b5c6-4495-9def-8618c3276fc2 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received event network-changed-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:47:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-616dfc05-e834-46d4-827f-47afca6e2bae req-5c0df29f-b5c6-4495-9def-8618c3276fc2 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Refreshing instance network info cache due to event network-changed-f5f212dd-f32e-4263-aa46-5176ea1a32d9. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:47:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-616dfc05-e834-46d4-827f-47afca6e2bae req-5c0df29f-b5c6-4495-9def-8618c3276fc2 service nova] Acquiring lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:47:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-616dfc05-e834-46d4-827f-47afca6e2bae req-5c0df29f-b5c6-4495-9def-8618c3276fc2 service nova] Acquired lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:47:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-616dfc05-e834-46d4-827f-47afca6e2bae req-5c0df29f-b5c6-4495-9def-8618c3276fc2 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Refreshing network info cache for port f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:47:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-616dfc05-e834-46d4-827f-47afca6e2bae req-5c0df29f-b5c6-4495-9def-8618c3276fc2 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updated VIF entry in instance network info cache for port f5f212dd-f32e-4263-aa46-5176ea1a32d9. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-616dfc05-e834-46d4-827f-47afca6e2bae req-5c0df29f-b5c6-4495-9def-8618c3276fc2 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating instance_info_cache with network_info: [{"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-616dfc05-e834-46d4-827f-47afca6e2bae req-5c0df29f-b5c6-4495-9def-8618c3276fc2 service nova] Releasing lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:47:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] No waiting events found dispatching network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:47:12 user nova-compute[75102]: WARNING nova.compute.manager [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received unexpected event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 16:47:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:47:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] No waiting events found dispatching network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:47:12 user nova-compute[75102]: WARNING nova.compute.manager [req-a7f43ada-e9ed-4d0e-a4ed-7ed6ae743694 req-ec6b0296-13ab-4348-884f-97cfd9ee0434 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received unexpected event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 10 16:47:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:47:13 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:47:13 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance spawned successfully.
Nov 10 16:47:13 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:47:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a7bfd5b3-d548-4d3b-b725-75aa7c1d84d4 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 12.103s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:15 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:47:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:47:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:47:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:47:15 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:47:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:47:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating instance_info_cache with network_info: [{"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.213s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG nova.objects.instance [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.147s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:17 user nova-compute[75102]: INFO nova.compute.manager [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attaching volume 0783f0da-4c57-4702-a02a-e8df331d053c to /dev/vdb
Nov 10 16:47:18 user nova-compute[75102]: DEBUG os_brick.utils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af69e82-5624-4ab2-8593-768b778fd5fa]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4779f35-8c0b-46ae-84fc-c829cfb9b6a3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:18 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:47:18 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:47:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8450MB free_disk=25.05657196044922GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ddc865f-51c2-425d-ab45-17d65cad6bc5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba5ea27-5dbb-4db5-b77b-63455f843497]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:47:18 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:47:18 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[40527799-089b-4052-a3be-2e1992bc0ae4]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG os_brick.utils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== get_connector_properties: return (658ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating existing volume attachment record: a4df9b91-be1b-4d56-96b7-dd2377fbaeec {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:47:18 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.724s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:47:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:22 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:24 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 16:47:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:28 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:47:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 16:47:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 16:47:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "af94042e-c7ce-499f-95b2-56ae24b43e65" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:47:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:47:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:47:28 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:47:28 user nova-compute[75102]: INFO nova.compute.claims [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Claim successful on node user
Nov 10 16:47:29 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.316s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:47:29 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:47:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:47:29 user nova-compute[75102]: INFO nova.virt.block_device [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Booting with volume c1a98f4f-dd8d-497e-b8b7-2c04d13e527f at /dev/vda
Nov 10 16:47:29 user nova-compute[75102]: DEBUG nova.policy [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96544e5daa74d51a232f565129b328a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3cd7409a94429d9262ef8a2a664d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG os_brick.utils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[95bef8d1-6fa5-4a4a-b416-8d7957cbf8df]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e2e871-96c7-4c3a-88f6-a28672058f75]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d84e03b-77cf-417c-9ecd-f41189ebe7f8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b843b3-395e-46e3-88db-0628315758f9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:47:29 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:47:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[66b873de-e5b9-413e-8489-31a9c259220b]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG os_brick.utils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== get_connector_properties: return (133ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Updating existing volume attachment record: 6372a4b0-577f-4f5b-ba2d-6f4185b3c714 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:47:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Successfully created port: 95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Successfully updated port: 95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "refresh_cache-af94042e-c7ce-499f-95b2-56ae24b43e65" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquired lock "refresh_cache-af94042e-c7ce-499f-95b2-56ae24b43e65" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-478fa913-debc-4670-9d67-e23245d194bf req-d4613fca-34cf-4a7d-b6cf-8e0ae3ca6e90 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received event network-changed-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-478fa913-debc-4670-9d67-e23245d194bf req-d4613fca-34cf-4a7d-b6cf-8e0ae3ca6e90 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Refreshing instance network info cache due to event network-changed-95c25cbe-3614-43b2-95c4-257817304ff5. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:47:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-478fa913-debc-4670-9d67-e23245d194bf req-d4613fca-34cf-4a7d-b6cf-8e0ae3ca6e90 service nova] Acquiring lock "refresh_cache-af94042e-c7ce-499f-95b2-56ae24b43e65" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:47:31 user nova-compute[75102]: DEBUG nova.network.neutron [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Updating instance_info_cache with network_info: [{"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:47:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Releasing lock "refresh_cache-af94042e-c7ce-499f-95b2-56ae24b43e65" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:47:31 user nova-compute[75102]: DEBUG nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Instance network_info: |[{"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:47:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-478fa913-debc-4670-9d67-e23245d194bf req-d4613fca-34cf-4a7d-b6cf-8e0ae3ca6e90 service nova] Acquired lock "refresh_cache-af94042e-c7ce-499f-95b2-56ae24b43e65" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:47:31 user nova-compute[75102]: DEBUG nova.network.neutron [req-478fa913-debc-4670-9d67-e23245d194bf req-d4613fca-34cf-4a7d-b6cf-8e0ae3ca6e90 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Refreshing network info cache for port 95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:47:31 user nova-compute[75102]: DEBUG nova.network.neutron [req-478fa913-debc-4670-9d67-e23245d194bf req-d4613fca-34cf-4a7d-b6cf-8e0ae3ca6e90 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Updated VIF entry in instance network info cache for port 95c25cbe-3614-43b2-95c4-257817304ff5. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:47:31 user nova-compute[75102]: DEBUG nova.network.neutron [req-478fa913-debc-4670-9d67-e23245d194bf req-d4613fca-34cf-4a7d-b6cf-8e0ae3ca6e90 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Updating instance_info_cache with network_info: [{"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:47:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-478fa913-debc-4670-9d67-e23245d194bf req-d4613fca-34cf-4a7d-b6cf-8e0ae3ca6e90 service nova] Releasing lock "refresh_cache-af94042e-c7ce-499f-95b2-56ae24b43e65" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:47:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:47:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:47:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:47:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:47:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:47:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkPdUEpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:47:56 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:47:56 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:47:56 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f3fda6b-a985-4272-91ae-7eedb4cbcc11]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:47:56 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f99f057-8324-4b5e-927e-db48288de1d0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c] added
Nov 10 16:47:56 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5ba010-714f-4f36-9b0c-7fa1cc28fea0]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d6cd0c-c3ca-4228-89c4-42280dfdb28a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkPdUEpy {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v XkPdUEpy" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a37e32e-b913-4be6-9b2d-f37b94c4169a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'XkPdUEpy'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace136d6-763e-436b-894d-9b30cbcd1542]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88e7334-b907-4f6a-bdfb-17b870637591]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:47:56 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:47:56 user nova-compute[75102]:  {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:47:56 user nova-compute[75102]: WARNING os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 16:47:56 user nova-compute[75102]: 
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[687fe371-367e-4d4b-aa9e-9cd40d237e4f]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c, portal: 172.16.0.220,3260]
Nov 10 16:47:56 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c, portal: 172.16.0.220,3260] successful.
Nov 10 16:47:56 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0ce984c-001a-4a93-8695-48d0b38cfdd2]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a827fde5-c769-4af3-879a-a5a72413916a]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)
Nov 10 16:47:56 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)
Nov 10 16:47:56 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dd7815-b114-456b-9952-0fbdbde0073b]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:47:56 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:47:57 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:47:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkPdUEpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:47:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.318s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:47:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23763303432653239', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:47:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23763303432653239', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:47:57 user nova-compute[75102]: DEBUG nova.objects.instance [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:47:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:47:57 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:47:57 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:47:57 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:47:57 user nova-compute[75102]:   <serial>0783f0da-4c57-4702-a02a-e8df331d053c</serial>
Nov 10 16:47:57 user nova-compute[75102]: </disk>
Nov 10 16:47:57 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:47:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:47:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:47:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No VIF found with MAC fa:16:3e:97:95:f1, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:47:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-21e627f7-0331-4428-afed-de9937ec0464 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 40.239s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:47:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:48:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:01 user nova-compute[75102]: INFO nova.compute.manager [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Rescuing
Nov 10 16:48:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:48:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquired lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:48:01 user nova-compute[75102]: DEBUG nova.network.neutron [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:48:01 user nova-compute[75102]: DEBUG nova.network.neutron [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updating instance_info_cache with network_info: [{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:48:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Releasing lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:48:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-ec2fea3f-20a6-4e1e-aeb0-8747816d3731 req-2a4af915-8ae5-4a8e-81d4-f6499af5021a service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-unplugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ec2fea3f-20a6-4e1e-aeb0-8747816d3731 req-2a4af915-8ae5-4a8e-81d4-f6499af5021a service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ec2fea3f-20a6-4e1e-aeb0-8747816d3731 req-2a4af915-8ae5-4a8e-81d4-f6499af5021a service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ec2fea3f-20a6-4e1e-aeb0-8747816d3731 req-2a4af915-8ae5-4a8e-81d4-f6499af5021a service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-ec2fea3f-20a6-4e1e-aeb0-8747816d3731 req-2a4af915-8ae5-4a8e-81d4-f6499af5021a service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-unplugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:48:02 user nova-compute[75102]: WARNING nova.compute.manager [req-ec2fea3f-20a6-4e1e-aeb0-8747816d3731 req-2a4af915-8ae5-4a8e-81d4-f6499af5021a service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-unplugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state active and task_state rescuing.
Nov 10 16:48:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Instance destroyed successfully.
Nov 10 16:48:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Attempting rescue
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75102) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Instance directory exists: not creating {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 16:48:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Creating image(s)
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'trusted_certs' on Instance uuid d70f5eeb-42bd-4612-8103-9e5bc8950cea {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue" returned: 0 in 0.052s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'migration_context' on Instance uuid d70f5eeb-42bd-4612-8103-9e5bc8950cea {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.base [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<d70f5eeb-42bd-4612-8103-9e5bc8950cea> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Start _get_guest_xml network_info=[{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "vif_mac": "fa:16:3e:15:5a:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a26f5e2e-1666-4272-b064-065539894418', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'resources' on Instance uuid d70f5eeb-42bd-4612-8103-9e5bc8950cea {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.base [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<d70f5eeb-42bd-4612-8103-9e5bc8950cea> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'numa_topology' on Instance uuid d70f5eeb-42bd-4612-8103-9e5bc8950cea {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.base [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<d70f5eeb-42bd-4612-8103-9e5bc8950cea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:48:02 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:48:02 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'vcpu_model' on Instance uuid d70f5eeb-42bd-4612-8103-9e5bc8950cea {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.base [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<d70f5eeb-42bd-4612-8103-9e5bc8950cea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1143453276',display_name='tempest-ServerRescueNegativeTestJSON-server-1143453276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1143453276',id=47,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-d8hc0fdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:46:19Z,user_data=None,user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=d70f5eeb-42bd-4612-8103-9e5bc8950cea,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "vif_mac": "fa:16:3e:15:5a:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "vif_mac": "fa:16:3e:15:5a:30"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:5a:30,bridge_name='br-int',has_traffic_filtering=True,id=e902d3a4-bca2-4364-aad8-a4fb12d69d31,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape902d3a4-bc') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'pci_devices' on Instance uuid d70f5eeb-42bd-4612-8103-9e5bc8950cea {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.objects.base [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<d70f5eeb-42bd-4612-8103-9e5bc8950cea> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:48:02 user nova-compute[75102]:   <uuid>d70f5eeb-42bd-4612-8103-9e5bc8950cea</uuid>
Nov 10 16:48:02 user nova-compute[75102]:   <name>instance-0000002f</name>
Nov 10 16:48:02 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:48:02 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:48:02 user nova-compute[75102]:   <metadata>
Nov 10 16:48:02 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:48:02 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:48:02 user nova-compute[75102]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1143453276</nova:name>
Nov 10 16:48:02 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:48:02</nova:creationTime>
Nov 10 16:48:02 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:48:02 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:48:02 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:48:02 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:48:02 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:48:02 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:48:02 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:48:02 user nova-compute[75102]:       <nova:owner>
Nov 10 16:48:02 user nova-compute[75102]:         <nova:user uuid="cd7ddbca327e4e2893563e02cd3d3754">tempest-ServerRescueNegativeTestJSON-662150154-project-member</nova:user>
Nov 10 16:48:02 user nova-compute[75102]:         <nova:project uuid="ea704446109948239b67b37c01c2c146">tempest-ServerRescueNegativeTestJSON-662150154</nova:project>
Nov 10 16:48:02 user nova-compute[75102]:       </nova:owner>
Nov 10 16:48:02 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:48:02 user nova-compute[75102]:       <nova:ports>
Nov 10 16:48:02 user nova-compute[75102]:         <nova:port uuid="e902d3a4-bca2-4364-aad8-a4fb12d69d31">
Nov 10 16:48:02 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 10 16:48:02 user nova-compute[75102]:         </nova:port>
Nov 10 16:48:02 user nova-compute[75102]:       </nova:ports>
Nov 10 16:48:02 user nova-compute[75102]:     </nova:instance>
Nov 10 16:48:02 user nova-compute[75102]:   </metadata>
Nov 10 16:48:02 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:48:02 user nova-compute[75102]:     <system>
Nov 10 16:48:02 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:48:02 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:48:02 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:48:02 user nova-compute[75102]:       <entry name="serial">d70f5eeb-42bd-4612-8103-9e5bc8950cea</entry>
Nov 10 16:48:02 user nova-compute[75102]:       <entry name="uuid">d70f5eeb-42bd-4612-8103-9e5bc8950cea</entry>
Nov 10 16:48:02 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:48:02 user nova-compute[75102]:     </system>
Nov 10 16:48:02 user nova-compute[75102]:   </sysinfo>
Nov 10 16:48:02 user nova-compute[75102]:   <os>
Nov 10 16:48:02 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:48:02 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:48:02 user nova-compute[75102]:   </os>
Nov 10 16:48:02 user nova-compute[75102]:   <features>
Nov 10 16:48:02 user nova-compute[75102]:     <acpi/>
Nov 10 16:48:02 user nova-compute[75102]:     <apic/>
Nov 10 16:48:02 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:48:02 user nova-compute[75102]:   </features>
Nov 10 16:48:02 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:48:02 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:48:02 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:48:02 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:48:02 user nova-compute[75102]:   </clock>
Nov 10 16:48:02 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:48:02 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:48:02 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:48:02 user nova-compute[75102]:   </cpu>
Nov 10 16:48:02 user nova-compute[75102]:   <devices>
Nov 10 16:48:02 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:48:02 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:48:02 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue"/>
Nov 10 16:48:02 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:48:02 user nova-compute[75102]:     </disk>
Nov 10 16:48:02 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:48:02 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:48:02 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk"/>
Nov 10 16:48:02 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:48:02 user nova-compute[75102]:     </disk>
Nov 10 16:48:02 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:48:02 user nova-compute[75102]:       <mac address="fa:16:3e:15:5a:30"/>
Nov 10 16:48:02 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:48:02 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:48:02 user nova-compute[75102]:       <target dev="tape902d3a4-bc"/>
Nov 10 16:48:02 user nova-compute[75102]:     </interface>
Nov 10 16:48:02 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:48:02 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/console.log" append="off"/>
Nov 10 16:48:02 user nova-compute[75102]:     </serial>
Nov 10 16:48:02 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:48:02 user nova-compute[75102]:     <video>
Nov 10 16:48:02 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:48:02 user nova-compute[75102]:     </video>
Nov 10 16:48:02 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:48:02 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:48:02 user nova-compute[75102]:     </rng>
Nov 10 16:48:02 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:48:02 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:48:02 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:48:02 user nova-compute[75102]:     </memballoon>
Nov 10 16:48:02 user nova-compute[75102]:   </devices>
Nov 10 16:48:02 user nova-compute[75102]: </domain>
Nov 10 16:48:02 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:48:02 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Instance destroyed successfully.
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:48:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No VIF found with MAC fa:16:3e:15:5a:30, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-4b86f02e-e0d5-471f-9a26-3739c488a035 req-a25b26e3-25f4-4775-9da6-30cab136849c service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4b86f02e-e0d5-471f-9a26-3739c488a035 req-a25b26e3-25f4-4775-9da6-30cab136849c service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4b86f02e-e0d5-471f-9a26-3739c488a035 req-a25b26e3-25f4-4775-9da6-30cab136849c service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4b86f02e-e0d5-471f-9a26-3739c488a035 req-a25b26e3-25f4-4775-9da6-30cab136849c service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG nova.compute.manager [req-4b86f02e-e0d5-471f-9a26-3739c488a035 req-a25b26e3-25f4-4775-9da6-30cab136849c service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:48:04 user nova-compute[75102]: WARNING nova.compute.manager [req-4b86f02e-e0d5-471f-9a26-3739c488a035 req-a25b26e3-25f4-4775-9da6-30cab136849c service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state active and task_state rescuing.
Nov 10 16:48:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:48:06 user nova-compute[75102]: WARNING nova.compute.manager [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state active and task_state rescuing.
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:48:06 user nova-compute[75102]: WARNING nova.compute.manager [req-15d1edc7-d8e0-48f6-b5bd-7eae84462484 req-cea8a8cb-4bef-4581-9f1a-bd9d1f68fa39 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state active and task_state rescuing.
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:48:06 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Creating image(s)
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Ensure instance console log exists: /opt/stack/data/nova/instances/af94042e-c7ce-499f-95b2-56ae24b43e65/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Start _get_guest_xml network_info=[{"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '6372a4b0-577f-4f5b-ba2d-6f4185b3c714', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSyIAzbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'af94042e-c7ce-499f-95b2-56ae24b43e65', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'serial': 'c1a98f4f-dd8d-497e-b8b7-2c04d13e527f'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:48:06 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:48:06 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSyIAzbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:48:06 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:48:06 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:48:06 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[edffa323-d586-4df8-9ea1-0449f3180fe8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:48:06 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9da7b5b6-228f-4891-9d2e-e89624ab4488]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f] added
Nov 10 16:48:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed27b5c-2f32-422f-833e-a97fa7855b38]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dea8716-8afc-448c-a5c3-70b443f883ec]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSyIAzbi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSyIAzbi" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e9b7e7e-4b0a-485c-a855-65a761754185]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qSyIAzbi'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe8180e-5a82-41d1-8db2-86b8a19e46b2]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[700e177e-a025-4273-8b87-63855d68a8a2]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)
Nov 10 16:48:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)
Nov 10 16:48:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[18955c4d-7f31-435c-8472-19e473e22403]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260]
Nov 10 16:48:06 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260] successful.
Nov 10 16:48:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbcd6e2-6959-4c26-b524-f31e4b6f23c1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d37e83f-9db0-40ad-9370-5a66f06435e1]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)
Nov 10 16:48:06 user nova-compute[75102]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:48:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)
Nov 10 16:48:06 user nova-compute[75102]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:48:06 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[093f37a7-080e-4a05-ab27-fe3a8a30bf23]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSyIAzbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:48:06 user nova-compute[75102]: DEBUG nova.compute.manager [None req-68f91234-5545-49b1-822b-22cd998d1872 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== connect_volume: return (1320ms) {'type': 'block', 'scsi_wwn': '23333333032363934', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333333032363934', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:47:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1732837014',display_name='tempest-TestVolumeBootPattern-server-1732837014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1732837014',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6FiKI8yHPuMKOdaO26PxW/aCJ98TUCcCllqqiqK2tNkUCO/KNPylVTg9aOD8uUhOmWSGRMK4FoJRAe1c23FiUDj6oHLaituQ2fadfYZyJkGulZUkOdUBgbcUsOPIriQ==',key_name='tempest-TestVolumeBootPattern-796132362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-90x8zszm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:47:29Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=af94042e-c7ce-499f-95b2-56ae24b43e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:31:a4,bridge_name='br-int',has_traffic_filtering=True,id=95c25cbe-3614-43b2-95c4-257817304ff5,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c25cbe-36') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'pci_devices' on Instance uuid af94042e-c7ce-499f-95b2-56ae24b43e65 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:48:07 user nova-compute[75102]:   <uuid>af94042e-c7ce-499f-95b2-56ae24b43e65</uuid>
Nov 10 16:48:07 user nova-compute[75102]:   <name>instance-00000030</name>
Nov 10 16:48:07 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:48:07 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:48:07 user nova-compute[75102]:   <metadata>
Nov 10 16:48:07 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:48:07 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:48:07 user nova-compute[75102]:       <nova:name>tempest-TestVolumeBootPattern-server-1732837014</nova:name>
Nov 10 16:48:07 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:48:06</nova:creationTime>
Nov 10 16:48:07 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:48:07 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:48:07 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:48:07 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:48:07 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:48:07 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:48:07 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:48:07 user nova-compute[75102]:       <nova:owner>
Nov 10 16:48:07 user nova-compute[75102]:         <nova:user uuid="e96544e5daa74d51a232f565129b328a">tempest-TestVolumeBootPattern-1535704831-project-member</nova:user>
Nov 10 16:48:07 user nova-compute[75102]:         <nova:project uuid="fe3cd7409a94429d9262ef8a2a664d7c">tempest-TestVolumeBootPattern-1535704831</nova:project>
Nov 10 16:48:07 user nova-compute[75102]:       </nova:owner>
Nov 10 16:48:07 user nova-compute[75102]:       <nova:ports>
Nov 10 16:48:07 user nova-compute[75102]:         <nova:port uuid="95c25cbe-3614-43b2-95c4-257817304ff5">
Nov 10 16:48:07 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 10 16:48:07 user nova-compute[75102]:         </nova:port>
Nov 10 16:48:07 user nova-compute[75102]:       </nova:ports>
Nov 10 16:48:07 user nova-compute[75102]:     </nova:instance>
Nov 10 16:48:07 user nova-compute[75102]:   </metadata>
Nov 10 16:48:07 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:48:07 user nova-compute[75102]:     <system>
Nov 10 16:48:07 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:48:07 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:48:07 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:48:07 user nova-compute[75102]:       <entry name="serial">af94042e-c7ce-499f-95b2-56ae24b43e65</entry>
Nov 10 16:48:07 user nova-compute[75102]:       <entry name="uuid">af94042e-c7ce-499f-95b2-56ae24b43e65</entry>
Nov 10 16:48:07 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:48:07 user nova-compute[75102]:     </system>
Nov 10 16:48:07 user nova-compute[75102]:   </sysinfo>
Nov 10 16:48:07 user nova-compute[75102]:   <os>
Nov 10 16:48:07 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:48:07 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:48:07 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:48:07 user nova-compute[75102]:   </os>
Nov 10 16:48:07 user nova-compute[75102]:   <features>
Nov 10 16:48:07 user nova-compute[75102]:     <acpi/>
Nov 10 16:48:07 user nova-compute[75102]:     <apic/>
Nov 10 16:48:07 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:48:07 user nova-compute[75102]:   </features>
Nov 10 16:48:07 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:48:07 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:48:07 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:48:07 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:48:07 user nova-compute[75102]:   </clock>
Nov 10 16:48:07 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:48:07 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:48:07 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:48:07 user nova-compute[75102]:   </cpu>
Nov 10 16:48:07 user nova-compute[75102]:   <devices>
Nov 10 16:48:07 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:48:07 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:48:07 user nova-compute[75102]:       <source dev="/dev/sdc"/>
Nov 10 16:48:07 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:48:07 user nova-compute[75102]:       <serial>c1a98f4f-dd8d-497e-b8b7-2c04d13e527f</serial>
Nov 10 16:48:07 user nova-compute[75102]:     </disk>
Nov 10 16:48:07 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:48:07 user nova-compute[75102]:       <mac address="fa:16:3e:19:31:a4"/>
Nov 10 16:48:07 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:48:07 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:48:07 user nova-compute[75102]:       <target dev="tap95c25cbe-36"/>
Nov 10 16:48:07 user nova-compute[75102]:     </interface>
Nov 10 16:48:07 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:48:07 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/af94042e-c7ce-499f-95b2-56ae24b43e65/console.log" append="off"/>
Nov 10 16:48:07 user nova-compute[75102]:     </serial>
Nov 10 16:48:07 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:48:07 user nova-compute[75102]:     <video>
Nov 10 16:48:07 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:48:07 user nova-compute[75102]:     </video>
Nov 10 16:48:07 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:48:07 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:48:07 user nova-compute[75102]:     </rng>
Nov 10 16:48:07 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:48:07 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:48:07 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:48:07 user nova-compute[75102]:     </memballoon>
Nov 10 16:48:07 user nova-compute[75102]:   </devices>
Nov 10 16:48:07 user nova-compute[75102]: </domain>
Nov 10 16:48:07 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:47:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1732837014',display_name='tempest-TestVolumeBootPattern-server-1732837014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1732837014',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6FiKI8yHPuMKOdaO26PxW/aCJ98TUCcCllqqiqK2tNkUCO/KNPylVTg9aOD8uUhOmWSGRMK4FoJRAe1c23FiUDj6oHLaituQ2fadfYZyJkGulZUkOdUBgbcUsOPIriQ==',key_name='tempest-TestVolumeBootPattern-796132362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-90x8zszm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:47:29Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=af94042e-c7ce-499f-95b2-56ae24b43e65,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:19:31:a4,bridge_name='br-int',has_traffic_filtering=True,id=95c25cbe-3614-43b2-95c4-257817304ff5,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c25cbe-36') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG os_vif [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:31:a4,bridge_name='br-int',has_traffic_filtering=True,id=95c25cbe-3614-43b2-95c4-257817304ff5,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c25cbe-36') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '671fb06e-291b-57d5-b1aa-b5674e4ad6a6', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap95c25cbe-36, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap95c25cbe-36, col_values=(('qos', UUID('b6f746ef-5e83-4652-b564-36f8e3026c57')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap95c25cbe-36, col_values=(('external_ids', {'iface-id': '95c25cbe-3614-43b2-95c4-257817304ff5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:19:31:a4', 'vm-uuid': 'af94042e-c7ce-499f-95b2-56ae24b43e65'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:07 user nova-compute[75102]: INFO os_vif [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:19:31:a4,bridge_name='br-int',has_traffic_filtering=True,id=95c25cbe-3614-43b2-95c4-257817304ff5,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c25cbe-36')
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:48:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No VIF found with MAC fa:16:3e:19:31:a4, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:48:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-b3bc008e-18a3-45f6-bc86-435a7d7a8773 req-2fd0b60a-b76c-4489-bae7-b9ee008df76d service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received event network-vif-plugged-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:48:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b3bc008e-18a3-45f6-bc86-435a7d7a8773 req-2fd0b60a-b76c-4489-bae7-b9ee008df76d service nova] Acquiring lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b3bc008e-18a3-45f6-bc86-435a7d7a8773 req-2fd0b60a-b76c-4489-bae7-b9ee008df76d service nova] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b3bc008e-18a3-45f6-bc86-435a7d7a8773 req-2fd0b60a-b76c-4489-bae7-b9ee008df76d service nova] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-b3bc008e-18a3-45f6-bc86-435a7d7a8773 req-2fd0b60a-b76c-4489-bae7-b9ee008df76d service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] No waiting events found dispatching network-vif-plugged-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:48:09 user nova-compute[75102]: WARNING nova.compute.manager [req-b3bc008e-18a3-45f6-bc86-435a7d7a8773 req-2fd0b60a-b76c-4489-bae7-b9ee008df76d service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received unexpected event network-vif-plugged-95c25cbe-3614-43b2-95c4-257817304ff5 for instance with vm_state building and task_state spawning.
Nov 10 16:48:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:48:11 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Instance spawned successfully.
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-61f47e75-f926-465c-b2a0-8cd7581ea068 req-eebe6217-5428-4ffe-9984-e5452cb0b555 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received event network-vif-plugged-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-61f47e75-f926-465c-b2a0-8cd7581ea068 req-eebe6217-5428-4ffe-9984-e5452cb0b555 service nova] Acquiring lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-61f47e75-f926-465c-b2a0-8cd7581ea068 req-eebe6217-5428-4ffe-9984-e5452cb0b555 service nova] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-61f47e75-f926-465c-b2a0-8cd7581ea068 req-eebe6217-5428-4ffe-9984-e5452cb0b555 service nova] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-61f47e75-f926-465c-b2a0-8cd7581ea068 req-eebe6217-5428-4ffe-9984-e5452cb0b555 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] No waiting events found dispatching network-vif-plugged-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:48:11 user nova-compute[75102]: WARNING nova.compute.manager [req-61f47e75-f926-465c-b2a0-8cd7581ea068 req-eebe6217-5428-4ffe-9984-e5452cb0b555 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received unexpected event network-vif-plugged-95c25cbe-3614-43b2-95c4-257817304ff5 for instance with vm_state building and task_state spawning.
Nov 10 16:48:11 user nova-compute[75102]: INFO nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Took 5.43 seconds to spawn the instance on the hypervisor.
Nov 10 16:48:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:48:11 user nova-compute[75102]: INFO nova.compute.manager [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Took 43.17 seconds to build instance.
Nov 10 16:48:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-404899e8-6081-479d-bfef-d56556bf6743 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 43.295s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.215s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.248s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:48:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:48:19 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:48:19 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:48:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8418MB free_disk=25.052505493164062GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:48:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance af94042e-c7ce-499f-95b2-56ae24b43e65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:48:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.431s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:22 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:22 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:48:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:48:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:40 user nova-compute[75102]: INFO nova.compute.manager [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Detaching volume 0783f0da-4c57-4702-a02a-e8df331d053c
Nov 10 16:48:40 user nova-compute[75102]: INFO nova.virt.block_device [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attempting to driver detach volume 0783f0da-4c57-4702-a02a-e8df331d053c from mountpoint /dev/vdb
Nov 10 16:48:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Attempting to detach device vdb from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:48:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:48:40 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:48:40 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:48:40 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:48:40 user nova-compute[75102]:   <serial>0783f0da-4c57-4702-a02a-e8df331d053c</serial>
Nov 10 16:48:40 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:48:40 user nova-compute[75102]: </disk>
Nov 10 16:48:40 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:48:40 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Successfully detached device vdb from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the persistent domain config.
Nov 10 16:48:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:48:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:48:40 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:48:40 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:48:40 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:48:40 user nova-compute[75102]:   <serial>0783f0da-4c57-4702-a02a-e8df331d053c</serial>
Nov 10 16:48:40 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:48:40 user nova-compute[75102]: </disk>
Nov 10 16:48:40 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:48:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:48:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:51 user nova-compute[75102]: INFO nova.compute.manager [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Terminating instance
Nov 10 16:48:51 user nova-compute[75102]: DEBUG nova.compute.manager [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:48:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-95ee40db-a153-425c-90fe-c24fd911d34e req-23cefbba-8d0b-436d-86a9-2053bd5ceeda service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-unplugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-95ee40db-a153-425c-90fe-c24fd911d34e req-23cefbba-8d0b-436d-86a9-2053bd5ceeda service nova] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-95ee40db-a153-425c-90fe-c24fd911d34e req-23cefbba-8d0b-436d-86a9-2053bd5ceeda service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-95ee40db-a153-425c-90fe-c24fd911d34e req-23cefbba-8d0b-436d-86a9-2053bd5ceeda service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-95ee40db-a153-425c-90fe-c24fd911d34e req-23cefbba-8d0b-436d-86a9-2053bd5ceeda service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] No waiting events found dispatching network-vif-unplugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-95ee40db-a153-425c-90fe-c24fd911d34e req-23cefbba-8d0b-436d-86a9-2053bd5ceeda service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-unplugged-2a7fa843-15f0-4f13-b376-9a42119762a9 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:48:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Instance destroyed successfully.
Nov 10 16:48:52 user nova-compute[75102]: DEBUG nova.objects.instance [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lazy-loading 'resources' on Instance uuid 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-10T16:43:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-800447560',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-800447560',id=43,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ9Iv2sEN9Z9IGQzI64NWZQAK+DCOamr6sw77MfIYQMebL7N/P15VDSV+5my1oNSWIcEk5NzDjBDOfc1jZR9RFaplw1rxj8gr3GUDIh7PFk1HOk6texLXVK2iFgJK+pwjw==',key_name='tempest-keypair-287893862',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:47:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b656df48b2114d27a9bf9fe6df81037f',ramdisk_id='',reservation_id='r-pejfuw9j',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1377452369',owner_user_name='tempest-AttachVolumeShelveTestJSON-1377452369-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:47:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='50787ee821e0400eb445fe8cd891e119',uuid=8ca14a6f-0eb8-42e4-a062-ea94d3e771e5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converting VIF {"id": "2a7fa843-15f0-4f13-b376-9a42119762a9", "address": "fa:16:3e:da:ba:32", "network": {"id": "776f7e23-b856-40d8-8e15-f6ea60e8146a", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-573247083-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.160", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b656df48b2114d27a9bf9fe6df81037f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7fa843-15", "ovs_interfaceid": "2a7fa843-15f0-4f13-b376-9a42119762a9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG os_vif [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a7fa843-15, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ed6de09-ed05-4a9c-92cd-dd91b7a5ad4e) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:48:52 user nova-compute[75102]: INFO os_vif [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:ba:32,bridge_name='br-int',has_traffic_filtering=True,id=2a7fa843-15f0-4f13-b376-9a42119762a9,network=Network(776f7e23-b856-40d8-8e15-f6ea60e8146a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7fa843-15')
Nov 10 16:48:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Deleting instance files /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5_del
Nov 10 16:48:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Deletion of /opt/stack/data/nova/instances/8ca14a6f-0eb8-42e4-a062-ea94d3e771e5_del complete
Nov 10 16:48:52 user nova-compute[75102]: INFO nova.compute.manager [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Took 0.72 seconds to destroy the instance on the hypervisor.
Nov 10 16:48:52 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:48:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:53 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:48:53 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Took 0.99 seconds to deallocate network for instance.
Nov 10 16:48:53 user nova-compute[75102]: DEBUG nova.compute.manager [req-a14b4232-76ea-4691-b6c0-ebd64f5bc471 req-4fdd8463-ac49-4a4c-8bff-ca76aaf86779 service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-deleted-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:48:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:53 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:48:53 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:48:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.212s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:53 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Deleted allocations for instance 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5
Nov 10 16:48:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-93693efb-9cc1-4ea3-9abc-962b3609a8f8 tempest-AttachVolumeShelveTestJSON-1377452369 tempest-AttachVolumeShelveTestJSON-1377452369-project-member] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.152s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-16c20f5b-e044-4a5d-b907-40807a109ddc req-99a3bbfb-163b-497d-9ed2-fccc91cbad6e service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:48:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-16c20f5b-e044-4a5d-b907-40807a109ddc req-99a3bbfb-163b-497d-9ed2-fccc91cbad6e service nova] Acquiring lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:48:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-16c20f5b-e044-4a5d-b907-40807a109ddc req-99a3bbfb-163b-497d-9ed2-fccc91cbad6e service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:48:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-16c20f5b-e044-4a5d-b907-40807a109ddc req-99a3bbfb-163b-497d-9ed2-fccc91cbad6e service nova] Lock "8ca14a6f-0eb8-42e4-a062-ea94d3e771e5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:48:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-16c20f5b-e044-4a5d-b907-40807a109ddc req-99a3bbfb-163b-497d-9ed2-fccc91cbad6e service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] No waiting events found dispatching network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:48:54 user nova-compute[75102]: WARNING nova.compute.manager [req-16c20f5b-e044-4a5d-b907-40807a109ddc req-99a3bbfb-163b-497d-9ed2-fccc91cbad6e service nova] [instance: 8ca14a6f-0eb8-42e4-a062-ea94d3e771e5] Received unexpected event network-vif-plugged-2a7fa843-15f0-4f13-b376-9a42119762a9 for instance with vm_state deleted and task_state None.
Nov 10 16:48:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:48:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:00 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 is timed out.
Nov 10 16:49:00 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Successfully detached device vdb from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the live domain config.
Nov 10 16:49:00 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'XkPdUEpy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:49:00 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:49:00 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f756c8ae-e6ce-4617-b2f0-91d0891bcdbd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:49:00 user nova-compute[75102]: No targets found.
Nov 10 16:49:00 user nova-compute[75102]: iSNS:
Nov 10 16:49:00 user nova-compute[75102]: No targets found.
Nov 10 16:49:00 user nova-compute[75102]: STATIC:
Nov 10 16:49:00 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f
Nov 10 16:49:00 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:49:00 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:49:00 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c
Nov 10 16:49:00 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:49:00 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:49:00 user nova-compute[75102]: FIRMWARE:
Nov 10 16:49:00 user nova-compute[75102]: No targets found.
Nov 10 16:49:00 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:49:00 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:49:00 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2c7f93d-c9c2-40d6-89ab-d07d2d59e44f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:00 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b25867-9ec6-420e-bf44-86cdb48d5631]: (4, ('tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)
Nov 10 16:49:01 user nova-compute[75102]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:49:01 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsi session list stdout=tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c (non-flash)
Nov 10 16:49:01 user nova-compute[75102]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:49:01 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74780b80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7257b170-bfe5-4eb3-88ab-244e573cc18e]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cce27494-6a8d-4376-99ee-4ce721bb1058]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[527d7688-9532-44e6-a70d-a70b6d32cc0a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7330ab78-6943-4139-bc55-04df4dad538d]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[55aa45a8-2e3e-4e58-9601-d607b0d239da]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d80a302-0326-4340-a72d-77d7c4448097]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c, portal: 172.16.0.220,3260]
Nov 10 16:49:01 user nova-compute[75102]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c, portal: 172.16.0.220,3260] successful.
Nov 10 16:49:01 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0783f0da-4c57-4702-a02a-e8df331d053c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a0a2e9d-ba37-4f20-af47-a4217994ce7a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.276s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== disconnect_volume: return (277ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:49:01 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:49:02 user nova-compute[75102]: DEBUG nova.objects.instance [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:49:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-810adbdb-dd9f-4487-bb07-efd1bf7d1a32 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.862s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:49:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:49:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:49:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:49:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:49:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:49:13 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:49:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updating instance_info_cache with network_info: [{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:49:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.234s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.217s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:19 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:49:19 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8386MB free_disk=25.07802963256836GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance af94042e-c7ce-499f-95b2-56ae24b43e65 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:49:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:49:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-31d6b2d8-d158-472e-9b9d-ed0ee492a9dd req-f4dcc44d-dd2a-44ff-9676-f068b7e4ccbc service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received event network-changed-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:49:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-31d6b2d8-d158-472e-9b9d-ed0ee492a9dd req-f4dcc44d-dd2a-44ff-9676-f068b7e4ccbc service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Refreshing instance network info cache due to event network-changed-95c25cbe-3614-43b2-95c4-257817304ff5. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:49:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-31d6b2d8-d158-472e-9b9d-ed0ee492a9dd req-f4dcc44d-dd2a-44ff-9676-f068b7e4ccbc service nova] Acquiring lock "refresh_cache-af94042e-c7ce-499f-95b2-56ae24b43e65" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:49:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-31d6b2d8-d158-472e-9b9d-ed0ee492a9dd req-f4dcc44d-dd2a-44ff-9676-f068b7e4ccbc service nova] Acquired lock "refresh_cache-af94042e-c7ce-499f-95b2-56ae24b43e65" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:49:20 user nova-compute[75102]: DEBUG nova.network.neutron [req-31d6b2d8-d158-472e-9b9d-ed0ee492a9dd req-f4dcc44d-dd2a-44ff-9676-f068b7e4ccbc service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Refreshing network info cache for port 95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:49:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-31d6b2d8-d158-472e-9b9d-ed0ee492a9dd req-f4dcc44d-dd2a-44ff-9676-f068b7e4ccbc service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Updated VIF entry in instance network info cache for port 95c25cbe-3614-43b2-95c4-257817304ff5. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:49:21 user nova-compute[75102]: DEBUG nova.network.neutron [req-31d6b2d8-d158-472e-9b9d-ed0ee492a9dd req-f4dcc44d-dd2a-44ff-9676-f068b7e4ccbc service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Updating instance_info_cache with network_info: [{"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:49:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-31d6b2d8-d158-472e-9b9d-ed0ee492a9dd req-f4dcc44d-dd2a-44ff-9676-f068b7e4ccbc service nova] Releasing lock "refresh_cache-af94042e-c7ce-499f-95b2-56ae24b43e65" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:49:21 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:49:21 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "af94042e-c7ce-499f-95b2-56ae24b43e65" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:49:22 user nova-compute[75102]: INFO nova.compute.manager [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Terminating instance
Nov 10 16:49:22 user nova-compute[75102]: DEBUG nova.compute.manager [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-a7f1fad4-061f-4e13-a03c-f85b0561bef5 req-a9f653aa-00b7-459d-8178-fd77e7852326 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received event network-vif-unplugged-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a7f1fad4-061f-4e13-a03c-f85b0561bef5 req-a9f653aa-00b7-459d-8178-fd77e7852326 service nova] Acquiring lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a7f1fad4-061f-4e13-a03c-f85b0561bef5 req-a9f653aa-00b7-459d-8178-fd77e7852326 service nova] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-a7f1fad4-061f-4e13-a03c-f85b0561bef5 req-a9f653aa-00b7-459d-8178-fd77e7852326 service nova] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-a7f1fad4-061f-4e13-a03c-f85b0561bef5 req-a9f653aa-00b7-459d-8178-fd77e7852326 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] No waiting events found dispatching network-vif-unplugged-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:49:22 user nova-compute[75102]: DEBUG nova.compute.manager [req-a7f1fad4-061f-4e13-a03c-f85b0561bef5 req-a9f653aa-00b7-459d-8178-fd77e7852326 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received event network-vif-unplugged-95c25cbe-3614-43b2-95c4-257817304ff5 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:49:23 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Instance destroyed successfully.
Nov 10 16:49:23 user nova-compute[75102]: DEBUG nova.objects.instance [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'resources' on Instance uuid af94042e-c7ce-499f-95b2-56ae24b43e65 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:47:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1732837014',display_name='tempest-TestVolumeBootPattern-server-1732837014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1732837014',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6FiKI8yHPuMKOdaO26PxW/aCJ98TUCcCllqqiqK2tNkUCO/KNPylVTg9aOD8uUhOmWSGRMK4FoJRAe1c23FiUDj6oHLaituQ2fadfYZyJkGulZUkOdUBgbcUsOPIriQ==',key_name='tempest-TestVolumeBootPattern-796132362',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:48:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-90x8zszm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:48:12Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=af94042e-c7ce-499f-95b2-56ae24b43e65,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "95c25cbe-3614-43b2-95c4-257817304ff5", "address": "fa:16:3e:19:31:a4", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.250", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap95c25cbe-36", "ovs_interfaceid": "95c25cbe-3614-43b2-95c4-257817304ff5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:19:31:a4,bridge_name='br-int',has_traffic_filtering=True,id=95c25cbe-3614-43b2-95c4-257817304ff5,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c25cbe-36') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_vif [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:31:a4,bridge_name='br-int',has_traffic_filtering=True,id=95c25cbe-3614-43b2-95c4-257817304ff5,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c25cbe-36') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap95c25cbe-36, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6f746ef-5e83-4652-b564-36f8e3026c57) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:23 user nova-compute[75102]: INFO os_vif [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:19:31:a4,bridge_name='br-int',has_traffic_filtering=True,id=95c25cbe-3614-43b2-95c4-257817304ff5,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap95c25cbe-36')
Nov 10 16:49:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSyIAzbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:49:23 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e47f7-fad0-42e4-8490-c5225af00aed]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:49:23 user nova-compute[75102]: No targets found.
Nov 10 16:49:23 user nova-compute[75102]: iSNS:
Nov 10 16:49:23 user nova-compute[75102]: No targets found.
Nov 10 16:49:23 user nova-compute[75102]: STATIC:
Nov 10 16:49:23 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f
Nov 10 16:49:23 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:49:23 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:49:23 user nova-compute[75102]: FIRMWARE:
Nov 10 16:49:23 user nova-compute[75102]: No targets found.
Nov 10 16:49:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:49:23 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:49:23 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[77981f8c-6f41-4a0d-ab2c-2afa5454219b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2342b6-0e01-4707-bb4f-0d2067303a96]: (4, ('tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:49:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:49:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f74782cb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a40963e-55cf-4187-a256-c3ad6269e51e]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[619a47c8-5116-4d5e-ac48-725bc6bbb144]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b041441-e2c1-4c5e-b25c-ebfe18f3018d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0375df22-150f-420c-ba54-10225c7384b4]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIO5d6ac238-33302694a8ff8820', '/dev/disk/by-id/scsi-23333333032363934', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_5d6ac238') {{(pid=85940) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d20ff2-05aa-4986-89ca-66bc131bf82b]: (4, None) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf3a86d2-f600-4a51-83d7-fceb86ccb63e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12f7320-d622-4511-9de2-f6eb00091060]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260]
Nov 10 16:49:23 user nova-compute[75102]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260] successful.
Nov 10 16:49:23 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[736e320e-53a1-4f02-a0ef-a0a248d3b1c6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== disconnect_volume: return (310ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:49:23 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Deleting instance files /opt/stack/data/nova/instances/af94042e-c7ce-499f-95b2-56ae24b43e65_del
Nov 10 16:49:23 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Deletion of /opt/stack/data/nova/instances/af94042e-c7ce-499f-95b2-56ae24b43e65_del complete
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:49:23 user nova-compute[75102]: INFO nova.compute.manager [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 10 16:49:23 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:49:23 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:49:24 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:49:24 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Took 0.98 seconds to deallocate network for instance.
Nov 10 16:49:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-560f97fe-7576-4766-b4db-e31e8385c71b req-cde89c45-fdb2-4f31-aa89-b588ff549986 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received event network-vif-deleted-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:49:24 user nova-compute[75102]: INFO nova.compute.manager [req-560f97fe-7576-4766-b4db-e31e8385c71b req-cde89c45-fdb2-4f31-aa89-b588ff549986 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Neutron deleted interface 95c25cbe-3614-43b2-95c4-257817304ff5; detaching it from the instance and deleting it from the info cache
Nov 10 16:49:24 user nova-compute[75102]: DEBUG nova.network.neutron [req-560f97fe-7576-4766-b4db-e31e8385c71b req-cde89c45-fdb2-4f31-aa89-b588ff549986 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:49:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-560f97fe-7576-4766-b4db-e31e8385c71b req-cde89c45-fdb2-4f31-aa89-b588ff549986 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Detach interface failed, port_id=95c25cbe-3614-43b2-95c4-257817304ff5, reason: Instance af94042e-c7ce-499f-95b2-56ae24b43e65 could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:49:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b7dc55c-549f-46aa-a948-b4ddde146c0b req-229e956d-c563-4eb1-984f-f4a278040c97 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received event network-vif-plugged-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:49:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b7dc55c-549f-46aa-a948-b4ddde146c0b req-229e956d-c563-4eb1-984f-f4a278040c97 service nova] Acquiring lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:49:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b7dc55c-549f-46aa-a948-b4ddde146c0b req-229e956d-c563-4eb1-984f-f4a278040c97 service nova] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:49:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7b7dc55c-549f-46aa-a948-b4ddde146c0b req-229e956d-c563-4eb1-984f-f4a278040c97 service nova] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:49:24 user nova-compute[75102]: DEBUG nova.compute.manager [req-7b7dc55c-549f-46aa-a948-b4ddde146c0b req-229e956d-c563-4eb1-984f-f4a278040c97 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] No waiting events found dispatching network-vif-plugged-95c25cbe-3614-43b2-95c4-257817304ff5 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:49:24 user nova-compute[75102]: WARNING nova.compute.manager [req-7b7dc55c-549f-46aa-a948-b4ddde146c0b req-229e956d-c563-4eb1-984f-f4a278040c97 service nova] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Received unexpected event network-vif-plugged-95c25cbe-3614-43b2-95c4-257817304ff5 for instance with vm_state active and task_state deleting.
Nov 10 16:49:25 user nova-compute[75102]: INFO nova.compute.manager [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: af94042e-c7ce-499f-95b2-56ae24b43e65] Took 0.99 seconds to detach 1 volumes for instance.
Nov 10 16:49:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:49:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:49:25 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:49:25 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:49:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:49:25 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Deleted allocations for instance af94042e-c7ce-499f-95b2-56ae24b43e65
Nov 10 16:49:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-f51a0d12-8abf-4d9a-b169-f4bbaffb3d41 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "af94042e-c7ce-499f-95b2-56ae24b43e65" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.593s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:49:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG nova.objects.instance [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:49:37 user nova-compute[75102]: INFO nova.compute.manager [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attaching volume 045c0658-f93f-4c51-ad0f-2b3484bed978 to /dev/vdb
Nov 10 16:49:37 user nova-compute[75102]: DEBUG os_brick.utils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c521b4c-7f8f-4a98-98a6-e5408f7fbf94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfcf56a-59fb-423b-a508-2688a8c31dde]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[24279185-ce2b-4a70-96ed-1a1d5ef97182]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5fd26b-b16e-4a32-bd3e-c1b9e074681a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:49:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:49:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:49:38 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:49:38 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:49:38 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a470541-07c8-47ce-b494-fd7491f0de6e]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:49:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:49:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:49:38 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:49:38 user nova-compute[75102]: DEBUG os_brick.utils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:49:38 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating existing volume attachment record: 1db925b9-24a4-4714-a9b0-fc58f1f36cc8 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:49:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:49:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:49:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "1eed0b35-1df9-442f-a467-68afaec4db3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:50:14 user nova-compute[75102]: INFO nova.compute.claims [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Claim successful on node user
Nov 10 16:50:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.528s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG nova.network.neutron [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:50:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:50:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:50:14 user nova-compute[75102]: DEBUG nova.policy [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96544e5daa74d51a232f565129b328a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3cd7409a94429d9262ef8a2a664d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:50:14 user nova-compute[75102]: INFO nova.virt.block_device [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Booting with volume c1a98f4f-dd8d-497e-b8b7-2c04d13e527f at /dev/vda
Nov 10 16:50:15 user nova-compute[75102]: DEBUG os_brick.utils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[77df40cd-52a5-4b3e-b4de-36dcd098626d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[17026f68-0b48-40bf-9d45-6f0d2505665b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6e01a2-fd60-44b1-8970-43ed1429bd16]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb746ce1-0194-4cb1-970d-297a8f371133]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:50:15 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:50:15 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f414a9d-b975-4642-8067-f61dd92fa4c1]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG os_brick.utils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updating existing volume attachment record: 687d6500-566f-439c-bffb-10e2921c3e72 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:50:15 user nova-compute[75102]: DEBUG nova.network.neutron [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Successfully created port: b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Successfully updated port: b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquired lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-8458b231-2b10-4e17-a2d9-ba6f6f52c166 req-d4339061-f06f-4a6a-aca8-276a58c5ff1f service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received event network-changed-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG nova.compute.manager [req-8458b231-2b10-4e17-a2d9-ba6f6f52c166 req-d4339061-f06f-4a6a-aca8-276a58c5ff1f service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Refreshing instance network info cache due to event network-changed-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8458b231-2b10-4e17-a2d9-ba6f6f52c166 req-d4339061-f06f-4a6a-aca8-276a58c5ff1f service nova] Acquiring lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updating instance_info_cache with network_info: [{"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Releasing lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Instance network_info: |[{"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8458b231-2b10-4e17-a2d9-ba6f6f52c166 req-d4339061-f06f-4a6a-aca8-276a58c5ff1f service nova] Acquired lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:50:16 user nova-compute[75102]: DEBUG nova.network.neutron [req-8458b231-2b10-4e17-a2d9-ba6f6f52c166 req-d4339061-f06f-4a6a-aca8-276a58c5ff1f service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Refreshing network info cache for port b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG nova.network.neutron [req-8458b231-2b10-4e17-a2d9-ba6f6f52c166 req-d4339061-f06f-4a6a-aca8-276a58c5ff1f service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updated VIF entry in instance network info cache for port b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG nova.network.neutron [req-8458b231-2b10-4e17-a2d9-ba6f6f52c166 req-d4339061-f06f-4a6a-aca8-276a58c5ff1f service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updating instance_info_cache with network_info: [{"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8458b231-2b10-4e17-a2d9-ba6f6f52c166 req-d4339061-f06f-4a6a-aca8-276a58c5ff1f service nova] Releasing lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.242s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.223s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:18 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:19 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:50:19 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8553MB free_disk=25.067241668701172GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1eed0b35-1df9-442f-a467-68afaec4db3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:50:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.330s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:20 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:20 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:20 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:50:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 16:50:21 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:21 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:50:21 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIRhekyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:50:22 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:50:22 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:50:22 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7e2a07f-8e76-4dfd-83b4-2bf9f2797839]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:50:22 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a63e12e7-9c6e-4de7-85a3-bbde27c166c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978] added
Nov 10 16:50:22 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[865fe5c0-f36f-4902-b28e-a655827b3c26]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0177656-b5c9-4832-b002-efb59b588e82]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIRhekyv {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xIRhekyv" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a5cb6c-8661-4bb3-a233-c3977346ac11]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xIRhekyv'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c0a7787-3e2f-4d9b-9e51-a57d692ed125]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[235dac21-9929-4615-ad8c-79522b8054f5]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:50:22 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:50:22 user nova-compute[75102]:  {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:50:22 user nova-compute[75102]: WARNING os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 16:50:22 user nova-compute[75102]: 
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3179d8e2-006d-423e-b08f-601c81e1efdd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978, portal: 172.16.0.220,3260]
Nov 10 16:50:22 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978, portal: 172.16.0.220,3260] successful.
Nov 10 16:50:22 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6af2d6c-4f3c-4599-aa18-602dcc690326]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e498180-43d5-43bb-a49b-468fd283b885]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)
Nov 10 16:50:22 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)
Nov 10 16:50:22 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.256s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a94c42c9-dda6-471a-8109-70d0e7989017]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:22 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIRhekyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.284s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== connect_volume: return (1285ms) {'type': 'block', 'scsi_wwn': '26262363739396530', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26262363739396530', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG nova.objects.instance [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:50:23 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:50:23 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:50:23 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:50:23 user nova-compute[75102]:   <serial>045c0658-f93f-4c51-ad0f-2b3484bed978</serial>
Nov 10 16:50:23 user nova-compute[75102]: </disk>
Nov 10 16:50:23 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:50:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No VIF found with MAC fa:16:3e:97:95:f1, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:50:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-6072be0a-c32c-4b94-b119-785f414218ad tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 46.221s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:26 user nova-compute[75102]: INFO nova.compute.manager [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Detaching volume 045c0658-f93f-4c51-ad0f-2b3484bed978
Nov 10 16:50:26 user nova-compute[75102]: INFO nova.virt.block_device [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attempting to driver detach volume 045c0658-f93f-4c51-ad0f-2b3484bed978 from mountpoint /dev/vdb
Nov 10 16:50:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Attempting to detach device vdb from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:50:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:50:26 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:50:26 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:50:26 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:50:26 user nova-compute[75102]:   <serial>045c0658-f93f-4c51-ad0f-2b3484bed978</serial>
Nov 10 16:50:26 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:50:26 user nova-compute[75102]: </disk>
Nov 10 16:50:26 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:50:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Successfully detached device vdb from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the persistent domain config.
Nov 10 16:50:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:50:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:50:26 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:50:26 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:50:26 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:50:26 user nova-compute[75102]:   <serial>045c0658-f93f-4c51-ad0f-2b3484bed978</serial>
Nov 10 16:50:26 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:50:26 user nova-compute[75102]: </disk>
Nov 10 16:50:26 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:50:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:50:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:50:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:50:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:50:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:50:39 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Creating image(s)
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Ensure instance console log exists: /opt/stack/data/nova/instances/1eed0b35-1df9-442f-a467-68afaec4db3a/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Start _get_guest_xml network_info=[{"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': '687d6500-566f-439c-bffb-10e2921c3e72', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSyIAzbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1eed0b35-1df9-442f-a467-68afaec4db3a', 'attached_at': '', 'detached_at': '', 'volume_id': 'c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'serial': 'c1a98f4f-dd8d-497e-b8b7-2c04d13e527f'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:50:39 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:50:39 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSyIAzbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:50:39 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:50:39 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:50:39 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7904a881-b716-4585-913e-01fc394a372a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:50:39 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1c7809-0803-454e-bbc5-4e370d1416dc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f] added
Nov 10 16:50:39 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[50715520-571c-4ede-b78d-4719345d29e1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b28dc81-c443-42af-acf9-b804a613a8ce]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSyIAzbi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qSyIAzbi" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[39fc76f0-0e32-46d3-b6e4-654e8ffd4527]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qSyIAzbi'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d5bf6b9-6d9f-4d4b-b9b8-ffc37c6d9da1]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[97549adb-e47e-42fa-a9e5-0dd1a43d332f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)
Nov 10 16:50:40 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)
Nov 10 16:50:40 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b61a461e-9c38-4073-bbef-09590f9ed690]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260]
Nov 10 16:50:40 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260] successful.
Nov 10 16:50:40 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[63fda1b1-80c1-42c1-99aa-32bc4b98bce5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda83d31-e921-4d46-87d6-74c86f74c4cb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)
Nov 10 16:50:40 user nova-compute[75102]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:50:40 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)
Nov 10 16:50:40 user nova-compute[75102]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:50:40 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.281s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] HCTL ('34', '-', '-', 0) found on session 44 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d50434-dab3-4d1d-b0dc-552904cf0d1a]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:40 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching for a device in session 44 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSyIAzbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.312s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23333333032363934', 'path': '/dev/sdc'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333333032363934', 'path': '/dev/sdc'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2098181851',display_name='tempest-TestVolumeBootPattern-server-2098181851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2098181851',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6FiKI8yHPuMKOdaO26PxW/aCJ98TUCcCllqqiqK2tNkUCO/KNPylVTg9aOD8uUhOmWSGRMK4FoJRAe1c23FiUDj6oHLaituQ2fadfYZyJkGulZUkOdUBgbcUsOPIriQ==',key_name='tempest-TestVolumeBootPattern-796132362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-sv7smc9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:50:15Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=1eed0b35-1df9-442f-a467-68afaec4db3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:39:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f1cc8f-4e') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.objects.instance [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'pci_devices' on Instance uuid 1eed0b35-1df9-442f-a467-68afaec4db3a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:50:41 user nova-compute[75102]:   <uuid>1eed0b35-1df9-442f-a467-68afaec4db3a</uuid>
Nov 10 16:50:41 user nova-compute[75102]:   <name>instance-00000031</name>
Nov 10 16:50:41 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:50:41 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:50:41 user nova-compute[75102]:   <metadata>
Nov 10 16:50:41 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:50:41 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:50:41 user nova-compute[75102]:       <nova:name>tempest-TestVolumeBootPattern-server-2098181851</nova:name>
Nov 10 16:50:41 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:50:39</nova:creationTime>
Nov 10 16:50:41 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:50:41 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:50:41 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:50:41 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:50:41 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:50:41 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:50:41 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:50:41 user nova-compute[75102]:       <nova:owner>
Nov 10 16:50:41 user nova-compute[75102]:         <nova:user uuid="e96544e5daa74d51a232f565129b328a">tempest-TestVolumeBootPattern-1535704831-project-member</nova:user>
Nov 10 16:50:41 user nova-compute[75102]:         <nova:project uuid="fe3cd7409a94429d9262ef8a2a664d7c">tempest-TestVolumeBootPattern-1535704831</nova:project>
Nov 10 16:50:41 user nova-compute[75102]:       </nova:owner>
Nov 10 16:50:41 user nova-compute[75102]:       <nova:ports>
Nov 10 16:50:41 user nova-compute[75102]:         <nova:port uuid="b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83">
Nov 10 16:50:41 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 10 16:50:41 user nova-compute[75102]:         </nova:port>
Nov 10 16:50:41 user nova-compute[75102]:       </nova:ports>
Nov 10 16:50:41 user nova-compute[75102]:     </nova:instance>
Nov 10 16:50:41 user nova-compute[75102]:   </metadata>
Nov 10 16:50:41 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:50:41 user nova-compute[75102]:     <system>
Nov 10 16:50:41 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:50:41 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:50:41 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:50:41 user nova-compute[75102]:       <entry name="serial">1eed0b35-1df9-442f-a467-68afaec4db3a</entry>
Nov 10 16:50:41 user nova-compute[75102]:       <entry name="uuid">1eed0b35-1df9-442f-a467-68afaec4db3a</entry>
Nov 10 16:50:41 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:50:41 user nova-compute[75102]:     </system>
Nov 10 16:50:41 user nova-compute[75102]:   </sysinfo>
Nov 10 16:50:41 user nova-compute[75102]:   <os>
Nov 10 16:50:41 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:50:41 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:50:41 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:50:41 user nova-compute[75102]:   </os>
Nov 10 16:50:41 user nova-compute[75102]:   <features>
Nov 10 16:50:41 user nova-compute[75102]:     <acpi/>
Nov 10 16:50:41 user nova-compute[75102]:     <apic/>
Nov 10 16:50:41 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:50:41 user nova-compute[75102]:   </features>
Nov 10 16:50:41 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:50:41 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:50:41 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:50:41 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:50:41 user nova-compute[75102]:   </clock>
Nov 10 16:50:41 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:50:41 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:50:41 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:50:41 user nova-compute[75102]:   </cpu>
Nov 10 16:50:41 user nova-compute[75102]:   <devices>
Nov 10 16:50:41 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:50:41 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:50:41 user nova-compute[75102]:       <source dev="/dev/sdc"/>
Nov 10 16:50:41 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:50:41 user nova-compute[75102]:       <serial>c1a98f4f-dd8d-497e-b8b7-2c04d13e527f</serial>
Nov 10 16:50:41 user nova-compute[75102]:     </disk>
Nov 10 16:50:41 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:50:41 user nova-compute[75102]:       <mac address="fa:16:3e:9e:39:ce"/>
Nov 10 16:50:41 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:50:41 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:50:41 user nova-compute[75102]:       <target dev="tapb9f1cc8f-4e"/>
Nov 10 16:50:41 user nova-compute[75102]:     </interface>
Nov 10 16:50:41 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:50:41 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/1eed0b35-1df9-442f-a467-68afaec4db3a/console.log" append="off"/>
Nov 10 16:50:41 user nova-compute[75102]:     </serial>
Nov 10 16:50:41 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:50:41 user nova-compute[75102]:     <video>
Nov 10 16:50:41 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:50:41 user nova-compute[75102]:     </video>
Nov 10 16:50:41 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:50:41 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:50:41 user nova-compute[75102]:     </rng>
Nov 10 16:50:41 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:50:41 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:50:41 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:50:41 user nova-compute[75102]:     </memballoon>
Nov 10 16:50:41 user nova-compute[75102]:   </devices>
Nov 10 16:50:41 user nova-compute[75102]: </domain>
Nov 10 16:50:41 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2098181851',display_name='tempest-TestVolumeBootPattern-server-2098181851',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2098181851',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6FiKI8yHPuMKOdaO26PxW/aCJ98TUCcCllqqiqK2tNkUCO/KNPylVTg9aOD8uUhOmWSGRMK4FoJRAe1c23FiUDj6oHLaituQ2fadfYZyJkGulZUkOdUBgbcUsOPIriQ==',key_name='tempest-TestVolumeBootPattern-796132362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-sv7smc9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:50:15Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=1eed0b35-1df9-442f-a467-68afaec4db3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:39:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f1cc8f-4e') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG os_vif [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:39:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f1cc8f-4e') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5a0ba2e6-1161-5ed8-bdb9-81e6a7086c54', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb9f1cc8f-4e, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb9f1cc8f-4e, col_values=(('qos', UUID('92286179-954a-4a92-afc2-c39a6add50ad')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb9f1cc8f-4e, col_values=(('external_ids', {'iface-id': 'b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:39:ce', 'vm-uuid': '1eed0b35-1df9-442f-a467-68afaec4db3a'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:41 user nova-compute[75102]: INFO os_vif [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:39:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f1cc8f-4e')
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:50:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No VIF found with MAC fa:16:3e:9e:39:ce, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:50:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-8a0fe9f4-384d-475f-9ca4-6716ef4d5597 req-83a3e9a4-a92e-4e8b-9e30-ee07df61c13a service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received event network-vif-plugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:50:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8a0fe9f4-384d-475f-9ca4-6716ef4d5597 req-83a3e9a4-a92e-4e8b-9e30-ee07df61c13a service nova] Acquiring lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8a0fe9f4-384d-475f-9ca4-6716ef4d5597 req-83a3e9a4-a92e-4e8b-9e30-ee07df61c13a service nova] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:43 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8a0fe9f4-384d-475f-9ca4-6716ef4d5597 req-83a3e9a4-a92e-4e8b-9e30-ee07df61c13a service nova] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:43 user nova-compute[75102]: DEBUG nova.compute.manager [req-8a0fe9f4-384d-475f-9ca4-6716ef4d5597 req-83a3e9a4-a92e-4e8b-9e30-ee07df61c13a service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] No waiting events found dispatching network-vif-plugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:50:43 user nova-compute[75102]: WARNING nova.compute.manager [req-8a0fe9f4-384d-475f-9ca4-6716ef4d5597 req-83a3e9a4-a92e-4e8b-9e30-ee07df61c13a service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received unexpected event network-vif-plugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 for instance with vm_state building and task_state spawning.
Nov 10 16:50:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:50:44 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Instance spawned successfully.
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:50:44 user nova-compute[75102]: INFO nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Took 5.24 seconds to spawn the instance on the hypervisor.
Nov 10 16:50:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:50:45 user nova-compute[75102]: INFO nova.compute.manager [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Took 30.89 seconds to build instance.
Nov 10 16:50:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-ae33e0f4-5884-403f-b61f-58b650b26363 req-45ffbd3a-9704-42e2-aaeb-918955444872 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received event network-vif-plugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:50:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ae33e0f4-5884-403f-b61f-58b650b26363 req-45ffbd3a-9704-42e2-aaeb-918955444872 service nova] Acquiring lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ae33e0f4-5884-403f-b61f-58b650b26363 req-45ffbd3a-9704-42e2-aaeb-918955444872 service nova] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-ae33e0f4-5884-403f-b61f-58b650b26363 req-45ffbd3a-9704-42e2-aaeb-918955444872 service nova] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:45 user nova-compute[75102]: DEBUG nova.compute.manager [req-ae33e0f4-5884-403f-b61f-58b650b26363 req-45ffbd3a-9704-42e2-aaeb-918955444872 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] No waiting events found dispatching network-vif-plugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:50:45 user nova-compute[75102]: WARNING nova.compute.manager [req-ae33e0f4-5884-403f-b61f-58b650b26363 req-45ffbd3a-9704-42e2-aaeb-918955444872 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received unexpected event network-vif-plugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 for instance with vm_state active and task_state None.
Nov 10 16:50:45 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-545b8410-a878-4e4d-aa76-fcb16446d0b4 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 30.994s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:46 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 is timed out.
Nov 10 16:50:46 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Successfully detached device vdb from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the live domain config.
Nov 10 16:50:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xIRhekyv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:50:46 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a567f6cf-7f10-45d8-ba61-7dd86dc35af0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:50:46 user nova-compute[75102]: No targets found.
Nov 10 16:50:46 user nova-compute[75102]: iSNS:
Nov 10 16:50:46 user nova-compute[75102]: No targets found.
Nov 10 16:50:46 user nova-compute[75102]: STATIC:
Nov 10 16:50:46 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f
Nov 10 16:50:46 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:50:46 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:50:46 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978
Nov 10 16:50:46 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:50:46 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:50:46 user nova-compute[75102]: FIRMWARE:
Nov 10 16:50:46 user nova-compute[75102]: No targets found.
Nov 10 16:50:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:50:46 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:50:46 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f43a3bd2-4226-48c8-9f8d-0a47ea796eb0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbd70f1-5681-499e-a149-68a1f71b7fff]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)
Nov 10 16:50:46 user nova-compute[75102]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:50:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 (non-flash)
Nov 10 16:50:46 user nova-compute[75102]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:50:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f746057e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d1aef4f-db5a-47a4-b025-c6669c66ee5e]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0f36cc0-8bf6-41e1-aa15-6a8e685df8aa]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5933ad-36db-41f3-8909-3941d1620b52]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[abbf3aa9-abe4-423d-813d-a65042725bce]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba30427e-7182-45c7-ba49-a3c27d479919]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[652dc853-e25d-41e0-8ea8-5d93d615009b]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978, portal: 172.16.0.220,3260]
Nov 10 16:50:46 user nova-compute[75102]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978, portal: 172.16.0.220,3260] successful.
Nov 10 16:50:46 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:045c0658-f93f-4c51-ad0f-2b3484bed978 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7dcc5f4-85ef-47a3-a423-ac2282dfa9b7]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.310s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== disconnect_volume: return (311ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:50:46 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:50:47 user nova-compute[75102]: DEBUG nova.objects.instance [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:50:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0386083b-ec62-4e9b-bbc2-1c590aebba5e tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.953s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:50:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:50:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:50:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:50:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:50:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:50:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:50:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:58 user nova-compute[75102]: INFO nova.compute.manager [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Rescuing
Nov 10 16:50:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:50:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquired lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:50:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:50:58 user nova-compute[75102]: DEBUG nova.network.neutron [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:50:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Releasing lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:50:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-eb9614fc-cc4a-4dc1-a791-dcc9c651908f req-c2c4bf12-93d4-4757-9cc2-3720d3d7fa30 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb9614fc-cc4a-4dc1-a791-dcc9c651908f req-c2c4bf12-93d4-4757-9cc2-3720d3d7fa30 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb9614fc-cc4a-4dc1-a791-dcc9c651908f req-c2c4bf12-93d4-4757-9cc2-3720d3d7fa30 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-eb9614fc-cc4a-4dc1-a791-dcc9c651908f req-c2c4bf12-93d4-4757-9cc2-3720d3d7fa30 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-eb9614fc-cc4a-4dc1-a791-dcc9c651908f req-c2c4bf12-93d4-4757-9cc2-3720d3d7fa30 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:50:59 user nova-compute[75102]: WARNING nova.compute.manager [req-eb9614fc-cc4a-4dc1-a791-dcc9c651908f req-c2c4bf12-93d4-4757-9cc2-3720d3d7fa30 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state active and task_state rescuing.
Nov 10 16:50:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:50:59 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Instance destroyed successfully.
Nov 10 16:50:59 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Attempting rescue
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75102) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Instance directory exists: not creating {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 16:50:59 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Creating image(s)
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.instance [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'trusted_certs' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue" returned: 0 in 0.050s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.248s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.instance [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'migration_context' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.base [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<fcd9ad66-cdd7-4016-9204-d2b0f40a1718> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Start _get_guest_xml network_info=[{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "vif_mac": "fa:16:3e:6a:7c:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a26f5e2e-1666-4272-b064-065539894418', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.instance [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'resources' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.base [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<fcd9ad66-cdd7-4016-9204-d2b0f40a1718> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.instance [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'numa_topology' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.base [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<fcd9ad66-cdd7-4016-9204-d2b0f40a1718> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:50:59 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:50:59 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.instance [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'vcpu_model' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.base [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<fcd9ad66-cdd7-4016-9204-d2b0f40a1718> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-813594258',display_name='tempest-ServerRescueNegativeTestJSON-server-813594258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-813594258',id=46,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:46:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-p0gvaucu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:46:19Z,user_data=None,user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=fcd9ad66-cdd7-4016-9204-d2b0f40a1718,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "vif_mac": "fa:16:3e:6a:7c:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "vif_mac": "fa:16:3e:6a:7c:bb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7c:bb,bridge_name='br-int',has_traffic_filtering=True,id=000d56c3-206f-46d9-a7a3-550d2b5a947e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap000d56c3-20') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.instance [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'pci_devices' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.objects.base [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<fcd9ad66-cdd7-4016-9204-d2b0f40a1718> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:50:59 user nova-compute[75102]:   <uuid>fcd9ad66-cdd7-4016-9204-d2b0f40a1718</uuid>
Nov 10 16:50:59 user nova-compute[75102]:   <name>instance-0000002e</name>
Nov 10 16:50:59 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:50:59 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:50:59 user nova-compute[75102]:   <metadata>
Nov 10 16:50:59 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:50:59 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:50:59 user nova-compute[75102]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-813594258</nova:name>
Nov 10 16:50:59 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:50:59</nova:creationTime>
Nov 10 16:50:59 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:50:59 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:50:59 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:50:59 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:50:59 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:50:59 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:50:59 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:50:59 user nova-compute[75102]:       <nova:owner>
Nov 10 16:50:59 user nova-compute[75102]:         <nova:user uuid="cd7ddbca327e4e2893563e02cd3d3754">tempest-ServerRescueNegativeTestJSON-662150154-project-member</nova:user>
Nov 10 16:50:59 user nova-compute[75102]:         <nova:project uuid="ea704446109948239b67b37c01c2c146">tempest-ServerRescueNegativeTestJSON-662150154</nova:project>
Nov 10 16:50:59 user nova-compute[75102]:       </nova:owner>
Nov 10 16:50:59 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:50:59 user nova-compute[75102]:       <nova:ports>
Nov 10 16:50:59 user nova-compute[75102]:         <nova:port uuid="000d56c3-206f-46d9-a7a3-550d2b5a947e">
Nov 10 16:50:59 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 16:50:59 user nova-compute[75102]:         </nova:port>
Nov 10 16:50:59 user nova-compute[75102]:       </nova:ports>
Nov 10 16:50:59 user nova-compute[75102]:     </nova:instance>
Nov 10 16:50:59 user nova-compute[75102]:   </metadata>
Nov 10 16:50:59 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:50:59 user nova-compute[75102]:     <system>
Nov 10 16:50:59 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:50:59 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:50:59 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:50:59 user nova-compute[75102]:       <entry name="serial">fcd9ad66-cdd7-4016-9204-d2b0f40a1718</entry>
Nov 10 16:50:59 user nova-compute[75102]:       <entry name="uuid">fcd9ad66-cdd7-4016-9204-d2b0f40a1718</entry>
Nov 10 16:50:59 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:50:59 user nova-compute[75102]:     </system>
Nov 10 16:50:59 user nova-compute[75102]:   </sysinfo>
Nov 10 16:50:59 user nova-compute[75102]:   <os>
Nov 10 16:50:59 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:50:59 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:50:59 user nova-compute[75102]:   </os>
Nov 10 16:50:59 user nova-compute[75102]:   <features>
Nov 10 16:50:59 user nova-compute[75102]:     <acpi/>
Nov 10 16:50:59 user nova-compute[75102]:     <apic/>
Nov 10 16:50:59 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:50:59 user nova-compute[75102]:   </features>
Nov 10 16:50:59 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:50:59 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:50:59 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:50:59 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:50:59 user nova-compute[75102]:   </clock>
Nov 10 16:50:59 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:50:59 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:50:59 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:50:59 user nova-compute[75102]:   </cpu>
Nov 10 16:50:59 user nova-compute[75102]:   <devices>
Nov 10 16:50:59 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:50:59 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:50:59 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue"/>
Nov 10 16:50:59 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:50:59 user nova-compute[75102]:     </disk>
Nov 10 16:50:59 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:50:59 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:50:59 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk"/>
Nov 10 16:50:59 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:50:59 user nova-compute[75102]:     </disk>
Nov 10 16:50:59 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:50:59 user nova-compute[75102]:       <mac address="fa:16:3e:6a:7c:bb"/>
Nov 10 16:50:59 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:50:59 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:50:59 user nova-compute[75102]:       <target dev="tap000d56c3-20"/>
Nov 10 16:50:59 user nova-compute[75102]:     </interface>
Nov 10 16:50:59 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:50:59 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/console.log" append="off"/>
Nov 10 16:50:59 user nova-compute[75102]:     </serial>
Nov 10 16:50:59 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:50:59 user nova-compute[75102]:     <video>
Nov 10 16:50:59 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:50:59 user nova-compute[75102]:     </video>
Nov 10 16:50:59 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:50:59 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:50:59 user nova-compute[75102]:     </rng>
Nov 10 16:50:59 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:50:59 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:50:59 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:50:59 user nova-compute[75102]:     </memballoon>
Nov 10 16:50:59 user nova-compute[75102]:   </devices>
Nov 10 16:50:59 user nova-compute[75102]: </domain>
Nov 10 16:50:59 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:50:59 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Instance destroyed successfully.
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:50:59 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No VIF found with MAC fa:16:3e:6a:7c:bb, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:51:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG nova.compute.manager [req-5f86d2f4-7007-4be2-9ca4-dc42941e1625 req-0b710707-1b52-4316-9e60-59ff6156da12 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5f86d2f4-7007-4be2-9ca4-dc42941e1625 req-0b710707-1b52-4316-9e60-59ff6156da12 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5f86d2f4-7007-4be2-9ca4-dc42941e1625 req-0b710707-1b52-4316-9e60-59ff6156da12 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5f86d2f4-7007-4be2-9ca4-dc42941e1625 req-0b710707-1b52-4316-9e60-59ff6156da12 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG nova.compute.manager [req-5f86d2f4-7007-4be2-9ca4-dc42941e1625 req-0b710707-1b52-4316-9e60-59ff6156da12 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:51:01 user nova-compute[75102]: WARNING nova.compute.manager [req-5f86d2f4-7007-4be2-9ca4-dc42941e1625 req-0b710707-1b52-4316-9e60-59ff6156da12 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state active and task_state rescuing.
Nov 10 16:51:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:51:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:51:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:51:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:51:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:51:03 user nova-compute[75102]: WARNING nova.compute.manager [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state active and task_state rescuing.
Nov 10 16:51:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:51:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:51:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:51:03 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:51:03 user nova-compute[75102]: DEBUG nova.compute.manager [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:51:03 user nova-compute[75102]: WARNING nova.compute.manager [req-c2dcfc4c-5779-4b47-8eae-2f712d50d2a5 req-c8e84aca-58c0-439b-8fbe-527e7b1f5b9d service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state active and task_state rescuing.
Nov 10 16:51:03 user nova-compute[75102]: DEBUG nova.compute.manager [None req-47bb2bec-2bee-4b65-8b0e-729d14f67f6f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:51:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:16 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:18 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:51:18 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:51:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:51:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:51:18 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:51:18 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating instance_info_cache with network_info: [{"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:51:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:21 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:51:21 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:51:21 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8420MB free_disk=25.062942504882812GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1eed0b35-1df9-442f-a467-68afaec4db3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:51:21 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:51:22 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:51:22 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:51:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:51:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.438s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:51:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:23 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:51:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG nova.objects.instance [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:51:35 user nova-compute[75102]: INFO nova.compute.manager [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attaching volume bf47cf64-fc01-4540-8617-a37b126150a1 to /dev/vdb
Nov 10 16:51:35 user nova-compute[75102]: DEBUG os_brick.utils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04f4318-2f7c-43b9-b553-b9586b36192c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[91d82a14-5762-431c-9abd-df8aa6c07e3b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[829cc9e9-6ee3-43cc-8b6f-504f62045673]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[66355f31-ef98-452d-96f4-da0abc144e8e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:51:35 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:51:35 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c374c378-13ca-44ad-bf16-75d7d53b5b52]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG os_brick.utils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating existing volume attachment record: 354d4ccf-c1c9-481b-b0bf-8b2416cfe657 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:51:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Verify base images {{(pid=75102) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75102) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Image id a26f5e2e-1666-4272-b064-065539894418 yields fingerprint 73bfe493de089368a125d59b54d99144b83d7dfb {{(pid=75102) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 10 16:51:41 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] image a26f5e2e-1666-4272-b064-065539894418 at (/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb): checking
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] image a26f5e2e-1666-4272-b064-065539894418 at (/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb): image is in use {{(pid=75102) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] d70f5eeb-42bd-4612-8103-9e5bc8950cea is a valid instance name {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] d70f5eeb-42bd-4612-8103-9e5bc8950cea has a disk file {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea is backed by 73bfe493de089368a125d59b54d99144b83d7dfb {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] 1eed0b35-1df9-442f-a467-68afaec4db3a is a valid instance name {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 is a valid instance name {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 has a disk file {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 is backed by 73bfe493de089368a125d59b54d99144b83d7dfb {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] fcd9ad66-cdd7-4016-9204-d2b0f40a1718 is a valid instance name {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] fcd9ad66-cdd7-4016-9204-d2b0f40a1718 has a disk file {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 10 16:51:41 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:51:42 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:51:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 is backed by 73bfe493de089368a125d59b54d99144b83d7dfb {{(pid=75102) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 10 16:51:42 user nova-compute[75102]: WARNING nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6
Nov 10 16:51:42 user nova-compute[75102]: WARNING nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904
Nov 10 16:51:42 user nova-compute[75102]: WARNING nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2
Nov 10 16:51:42 user nova-compute[75102]: WARNING nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1
Nov 10 16:51:42 user nova-compute[75102]: WARNING nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9
Nov 10 16:51:42 user nova-compute[75102]: WARNING nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405
Nov 10 16:51:42 user nova-compute[75102]: WARNING nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10
Nov 10 16:51:42 user nova-compute[75102]: WARNING nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Unknown base file: /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Active base files: /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Removable base files: /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6 /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904 /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2 /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1 /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9 /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405 /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10 /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/22c5fec5db88402e0f8fac80930d1bfc2058eff6
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0d9d3a70a66ee6b5cce1fe75f3413f6ced9eb904
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e880dd4bdf222012dcd32fd58fbcd5cbe327cdd2
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/4dcff73873cf61711474c0cb3e8ec55fc028c4d1
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/a6d1f157f769604b4b7c3faf716f917a6a580fc9
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/e3b6cfd187b984b776c5d8a6e86927a773cec405
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/27d411d13a3544a43ae67c75279e7e206cb4ad10
Nov 10 16:51:42 user nova-compute[75102]: INFO nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2bca8097731af33d51c4ce15c257ef8dadbfb6f2
Nov 10 16:51:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Verification complete {{(pid=75102) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 10 16:51:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Verify swap images {{(pid=75102) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 10 16:51:42 user nova-compute[75102]: DEBUG nova.virt.libvirt.imagecache [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Verify ephemeral images {{(pid=75102) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 10 16:51:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:51:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:51:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:51:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:51:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:51:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:52:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-56709841-df6b-4c67-bb5e-eb900da62abb req-f6ad403f-b522-43b8-b95b-e50ddcb125d0 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received event network-changed-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:52:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-56709841-df6b-4c67-bb5e-eb900da62abb req-f6ad403f-b522-43b8-b95b-e50ddcb125d0 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Refreshing instance network info cache due to event network-changed-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:52:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-56709841-df6b-4c67-bb5e-eb900da62abb req-f6ad403f-b522-43b8-b95b-e50ddcb125d0 service nova] Acquiring lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:52:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-56709841-df6b-4c67-bb5e-eb900da62abb req-f6ad403f-b522-43b8-b95b-e50ddcb125d0 service nova] Acquired lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:52:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-56709841-df6b-4c67-bb5e-eb900da62abb req-f6ad403f-b522-43b8-b95b-e50ddcb125d0 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Refreshing network info cache for port b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:52:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-56709841-df6b-4c67-bb5e-eb900da62abb req-f6ad403f-b522-43b8-b95b-e50ddcb125d0 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updated VIF entry in instance network info cache for port b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:52:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-56709841-df6b-4c67-bb5e-eb900da62abb req-f6ad403f-b522-43b8-b95b-e50ddcb125d0 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updating instance_info_cache with network_info: [{"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:52:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-56709841-df6b-4c67-bb5e-eb900da62abb req-f6ad403f-b522-43b8-b95b-e50ddcb125d0 service nova] Releasing lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:52:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:52:15 user nova-compute[75102]: INFO nova.compute.claims [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Claim successful on node user
Nov 10 16:52:15 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.305s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:52:15 user nova-compute[75102]: DEBUG nova.network.neutron [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:52:15 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:52:15 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG nova.policy [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ffff704c546e40ae85fbe8e74402ff25', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c931e79171af44b39dca71ec088fd01f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:52:16 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Creating image(s)
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "/opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "/opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "/opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.200s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk 1073741824" returned: 0 in 0.063s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.250s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG nova.network.neutron [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Successfully created port: bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.207s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:52:16 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Cannot resize image /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Ensure instance console log exists: /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.network.neutron [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Successfully updated port: bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "refresh_cache-9c68c3b1-4586-49f4-9042-c4ef622b1638" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquired lock "refresh_cache-9c68c3b1-4586-49f4-9042-c4ef622b1638" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.network.neutron [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-06f8f236-ac27-4818-bde9-d80bdc87f5d9 req-7960f253-7129-4c95-8ba9-c2a93bb20cd4 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received event network-changed-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-06f8f236-ac27-4818-bde9-d80bdc87f5d9 req-7960f253-7129-4c95-8ba9-c2a93bb20cd4 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Refreshing instance network info cache due to event network-changed-bd64bf27-431c-4a0f-8999-53df16ea62d7. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-06f8f236-ac27-4818-bde9-d80bdc87f5d9 req-7960f253-7129-4c95-8ba9-c2a93bb20cd4 service nova] Acquiring lock "refresh_cache-9c68c3b1-4586-49f4-9042-c4ef622b1638" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.network.neutron [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.network.neutron [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Updating instance_info_cache with network_info: [{"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Releasing lock "refresh_cache-9c68c3b1-4586-49f4-9042-c4ef622b1638" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Instance network_info: |[{"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-06f8f236-ac27-4818-bde9-d80bdc87f5d9 req-7960f253-7129-4c95-8ba9-c2a93bb20cd4 service nova] Acquired lock "refresh_cache-9c68c3b1-4586-49f4-9042-c4ef622b1638" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.network.neutron [req-06f8f236-ac27-4818-bde9-d80bdc87f5d9 req-7960f253-7129-4c95-8ba9-c2a93bb20cd4 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Refreshing network info cache for port bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Start _get_guest_xml network_info=[{"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:52:17 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:52:17 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1942845567',display_name='tempest-TestServerVolumeAttachmentScenario-server-1942845567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1942845567',id=50,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7zpCc85fGr6XMhJrd0wG7QTmgLzkMX8uspbKaIgg4c++i3YISonncBzuK1zdwoxmDno6C7ZtXcVEusnzBrWa8E/AjPSSzb2NAlJUj6HNZadHcGC1LhtGJ0ZG03vr11ag==',key_name='tempest-keypair-1266934672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931e79171af44b39dca71ec088fd01f',ramdisk_id='',reservation_id='r-0pl8gvc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-852154045',owner_user_name='tempest-TestServerVolumeAttachmentScenario-852154045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:52:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffff704c546e40ae85fbe8e74402ff25',uuid=9c68c3b1-4586-49f4-9042-c4ef622b1638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Converting VIF {"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=bd64bf27-431c-4a0f-8999-53df16ea62d7,network=Network(51ac06f7-9da5-4d50-8165-f56e811e1d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd64bf27-43') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.objects.instance [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lazy-loading 'pci_devices' on Instance uuid 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:52:17 user nova-compute[75102]:   <uuid>9c68c3b1-4586-49f4-9042-c4ef622b1638</uuid>
Nov 10 16:52:17 user nova-compute[75102]:   <name>instance-00000032</name>
Nov 10 16:52:17 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:52:17 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:52:17 user nova-compute[75102]:   <metadata>
Nov 10 16:52:17 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:52:17 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:52:17 user nova-compute[75102]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1942845567</nova:name>
Nov 10 16:52:17 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:52:17</nova:creationTime>
Nov 10 16:52:17 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:52:17 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:52:17 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:52:17 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:52:17 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:52:17 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:52:17 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:52:17 user nova-compute[75102]:       <nova:owner>
Nov 10 16:52:17 user nova-compute[75102]:         <nova:user uuid="ffff704c546e40ae85fbe8e74402ff25">tempest-TestServerVolumeAttachmentScenario-852154045-project-member</nova:user>
Nov 10 16:52:17 user nova-compute[75102]:         <nova:project uuid="c931e79171af44b39dca71ec088fd01f">tempest-TestServerVolumeAttachmentScenario-852154045</nova:project>
Nov 10 16:52:17 user nova-compute[75102]:       </nova:owner>
Nov 10 16:52:17 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:52:17 user nova-compute[75102]:       <nova:ports>
Nov 10 16:52:17 user nova-compute[75102]:         <nova:port uuid="bd64bf27-431c-4a0f-8999-53df16ea62d7">
Nov 10 16:52:17 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 10 16:52:17 user nova-compute[75102]:         </nova:port>
Nov 10 16:52:17 user nova-compute[75102]:       </nova:ports>
Nov 10 16:52:17 user nova-compute[75102]:     </nova:instance>
Nov 10 16:52:17 user nova-compute[75102]:   </metadata>
Nov 10 16:52:17 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:52:17 user nova-compute[75102]:     <system>
Nov 10 16:52:17 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:52:17 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:52:17 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:52:17 user nova-compute[75102]:       <entry name="serial">9c68c3b1-4586-49f4-9042-c4ef622b1638</entry>
Nov 10 16:52:17 user nova-compute[75102]:       <entry name="uuid">9c68c3b1-4586-49f4-9042-c4ef622b1638</entry>
Nov 10 16:52:17 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:52:17 user nova-compute[75102]:     </system>
Nov 10 16:52:17 user nova-compute[75102]:   </sysinfo>
Nov 10 16:52:17 user nova-compute[75102]:   <os>
Nov 10 16:52:17 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:52:17 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:52:17 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:52:17 user nova-compute[75102]:   </os>
Nov 10 16:52:17 user nova-compute[75102]:   <features>
Nov 10 16:52:17 user nova-compute[75102]:     <acpi/>
Nov 10 16:52:17 user nova-compute[75102]:     <apic/>
Nov 10 16:52:17 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:52:17 user nova-compute[75102]:   </features>
Nov 10 16:52:17 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:52:17 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:52:17 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:52:17 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:52:17 user nova-compute[75102]:   </clock>
Nov 10 16:52:17 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:52:17 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:52:17 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:52:17 user nova-compute[75102]:   </cpu>
Nov 10 16:52:17 user nova-compute[75102]:   <devices>
Nov 10 16:52:17 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:52:17 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:52:17 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk"/>
Nov 10 16:52:17 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:52:17 user nova-compute[75102]:     </disk>
Nov 10 16:52:17 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:52:17 user nova-compute[75102]:       <mac address="fa:16:3e:2f:53:1d"/>
Nov 10 16:52:17 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:52:17 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:52:17 user nova-compute[75102]:       <target dev="tapbd64bf27-43"/>
Nov 10 16:52:17 user nova-compute[75102]:     </interface>
Nov 10 16:52:17 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:52:17 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/console.log" append="off"/>
Nov 10 16:52:17 user nova-compute[75102]:     </serial>
Nov 10 16:52:17 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:52:17 user nova-compute[75102]:     <video>
Nov 10 16:52:17 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:52:17 user nova-compute[75102]:     </video>
Nov 10 16:52:17 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:52:17 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:52:17 user nova-compute[75102]:     </rng>
Nov 10 16:52:17 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:52:17 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:52:17 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:52:17 user nova-compute[75102]:     </memballoon>
Nov 10 16:52:17 user nova-compute[75102]:   </devices>
Nov 10 16:52:17 user nova-compute[75102]: </domain>
Nov 10 16:52:17 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1942845567',display_name='tempest-TestServerVolumeAttachmentScenario-server-1942845567',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1942845567',id=50,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7zpCc85fGr6XMhJrd0wG7QTmgLzkMX8uspbKaIgg4c++i3YISonncBzuK1zdwoxmDno6C7ZtXcVEusnzBrWa8E/AjPSSzb2NAlJUj6HNZadHcGC1LhtGJ0ZG03vr11ag==',key_name='tempest-keypair-1266934672',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c931e79171af44b39dca71ec088fd01f',ramdisk_id='',reservation_id='r-0pl8gvc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-852154045',owner_user_name='tempest-TestServerVolumeAttachmentScenario-852154045-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:52:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffff704c546e40ae85fbe8e74402ff25',uuid=9c68c3b1-4586-49f4-9042-c4ef622b1638,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Converting VIF {"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2f:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=bd64bf27-431c-4a0f-8999-53df16ea62d7,network=Network(51ac06f7-9da5-4d50-8165-f56e811e1d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd64bf27-43') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG os_vif [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=bd64bf27-431c-4a0f-8999-53df16ea62d7,network=Network(51ac06f7-9da5-4d50-8165-f56e811e1d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd64bf27-43') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1f1154b9-d11e-5965-895b-b03d05817eb8', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapbd64bf27-43, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapbd64bf27-43, col_values=(('qos', UUID('562fc226-dfee-4996-ac0a-5ed622ab5dfc')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapbd64bf27-43, col_values=(('external_ids', {'iface-id': 'bd64bf27-431c-4a0f-8999-53df16ea62d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2f:53:1d', 'vm-uuid': '9c68c3b1-4586-49f4-9042-c4ef622b1638'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:17 user nova-compute[75102]: INFO os_vif [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2f:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=bd64bf27-431c-4a0f-8999-53df16ea62d7,network=Network(51ac06f7-9da5-4d50-8165-f56e811e1d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd64bf27-43')
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:52:17 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] No VIF found with MAC fa:16:3e:2f:53:1d, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:52:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-06f8f236-ac27-4818-bde9-d80bdc87f5d9 req-7960f253-7129-4c95-8ba9-c2a93bb20cd4 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Updated VIF entry in instance network info cache for port bd64bf27-431c-4a0f-8999-53df16ea62d7. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:52:18 user nova-compute[75102]: DEBUG nova.network.neutron [req-06f8f236-ac27-4818-bde9-d80bdc87f5d9 req-7960f253-7129-4c95-8ba9-c2a93bb20cd4 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Updating instance_info_cache with network_info: [{"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:52:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-06f8f236-ac27-4818-bde9-d80bdc87f5d9 req-7960f253-7129-4c95-8ba9-c2a93bb20cd4 service nova] Releasing lock "refresh_cache-9c68c3b1-4586-49f4-9042-c4ef622b1638" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:52:18 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-c93a72c4-3d4a-40da-bb8f-53aaaf878635 req-3a38890d-1bd6-4c06-9874-5ecc46a212d4 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received event network-vif-plugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c93a72c4-3d4a-40da-bb8f-53aaaf878635 req-3a38890d-1bd6-4c06-9874-5ecc46a212d4 service nova] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c93a72c4-3d4a-40da-bb8f-53aaaf878635 req-3a38890d-1bd6-4c06-9874-5ecc46a212d4 service nova] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-c93a72c4-3d4a-40da-bb8f-53aaaf878635 req-3a38890d-1bd6-4c06-9874-5ecc46a212d4 service nova] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-c93a72c4-3d4a-40da-bb8f-53aaaf878635 req-3a38890d-1bd6-4c06-9874-5ecc46a212d4 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] No waiting events found dispatching network-vif-plugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:52:19 user nova-compute[75102]: WARNING nova.compute.manager [req-c93a72c4-3d4a-40da-bb8f-53aaaf878635 req-3a38890d-1bd6-4c06-9874-5ecc46a212d4 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received unexpected event network-vif-plugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 for instance with vm_state building and task_state spawning.
Nov 10 16:52:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:19 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue --force-share --output=json" returned: 0 in 0.198s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-5f6a5c24-b22e-4a9b-9849-c2cf187e52c0 req-e098752d-98c5-430f-85c4-b119f08a9d57 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received event network-vif-plugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5f6a5c24-b22e-4a9b-9849-c2cf187e52c0 req-e098752d-98c5-430f-85c4-b119f08a9d57 service nova] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5f6a5c24-b22e-4a9b-9849-c2cf187e52c0 req-e098752d-98c5-430f-85c4-b119f08a9d57 service nova] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5f6a5c24-b22e-4a9b-9849-c2cf187e52c0 req-e098752d-98c5-430f-85c4-b119f08a9d57 service nova] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.compute.manager [req-5f6a5c24-b22e-4a9b-9849-c2cf187e52c0 req-e098752d-98c5-430f-85c4-b119f08a9d57 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] No waiting events found dispatching network-vif-plugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:52:21 user nova-compute[75102]: WARNING nova.compute.manager [req-5f6a5c24-b22e-4a9b-9849-c2cf187e52c0 req-e098752d-98c5-430f-85c4-b119f08a9d57 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received unexpected event network-vif-plugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 for instance with vm_state building and task_state spawning.
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:52:21 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Instance spawned successfully.
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:21 user nova-compute[75102]: INFO nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Took 5.57 seconds to spawn the instance on the hypervisor.
Nov 10 16:52:21 user nova-compute[75102]: DEBUG nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.182s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:21 user nova-compute[75102]: INFO nova.compute.manager [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Took 6.33 seconds to build instance.
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-1dff4390-166d-4d80-ae5c-1abc33b79e35 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.544s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:23 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:52:23 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8396MB free_disk=25.050582885742188GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1eed0b35-1df9-442f-a467-68afaec4db3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:52:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.716s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:24 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:52:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBXUhdFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:52:27 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:52:27 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:52:27 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a1209a-f56d-4d47-b03e-3c6322948cd6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:52:27 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e2a28f-9356-4ca3-8d44-7806842c5296]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1] added
Nov 10 16:52:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5013ae02-852a-4004-ab7a-f755db2a59db]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[122693cc-27ef-4c26-bb44-176f0c37363a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBXUhdFD {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HBXUhdFD" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[af643c92-9631-4f66-85f8-6ed9c9c340a6]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HBXUhdFD'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6878a7-8ae3-404f-bc25-c23af4da0b0a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c295e285-65b6-436d-abc1-8b07a97bffba]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:52:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:52:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --login" returned: 0 in 0.051s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0080dd-00a0-4ae9-a755-6f1a32b76b7c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1, portal: 172.16.0.220,3260]
Nov 10 16:52:27 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1, portal: 172.16.0.220,3260] successful.
Nov 10 16:52:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eca01d-8373-4a88-899c-434a86417693]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d37fa37-bff6-411c-9809-9c471c7f4f48]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:52:27 user nova-compute[75102]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 (non-flash)
Nov 10 16:52:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:52:27 user nova-compute[75102]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 (non-flash)
Nov 10 16:52:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] HCTL ('33', '-', '-', 0) found on session 45 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e16f57f-452b-4a1f-85b0-1e61e4bf93b2]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Searching for a device in session 45 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:52:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBXUhdFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "d816effe-bfce-48b9-b434-712fc862bb5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "d816effe-bfce-48b9-b434-712fc862bb5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:52:28 user nova-compute[75102]: INFO nova.compute.claims [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Claim successful on node user
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== connect_volume: return (1314ms) {'type': 'block', 'scsi_wwn': '23434626566353734', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434626566353734', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.objects.instance [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.312s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:52:28 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:52:28 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:52:28 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:52:28 user nova-compute[75102]:   <serial>bf47cf64-fc01-4540-8617-a37b126150a1</serial>
Nov 10 16:52:28 user nova-compute[75102]: </disk>
Nov 10 16:52:28 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:52:28 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:52:28 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:52:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG nova.policy [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'e96544e5daa74d51a232f565129b328a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe3cd7409a94429d9262ef8a2a664d7c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:52:29 user nova-compute[75102]: INFO nova.virt.block_device [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Booting with volume af5e61a7-1845-4047-8359-8fef6475ef33 at /dev/vda
Nov 10 16:52:29 user nova-compute[75102]: DEBUG os_brick.utils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.030s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03da9ef-552d-4450-856c-58da741f8e0b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad0363e-d6f2-474e-8e7c-006577e7f536]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f096b671-a750-4d94-a208-456a6cfe0127]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a398854-10ff-470c-802a-7c54f7335a66]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:52:29 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78a0b55-95f3-4f24-a8af-968f9abbdb83]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG os_brick.utils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updating existing volume attachment record: f857de50-5a35-4a71-8d8d-65feeaf0bbe9 {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] No VIF found with MAC fa:16:3e:97:95:f1, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-804c00e5-aba8-4e3b-8b3b-1fc379562619 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 54.203s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Successfully created port: 02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:52:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Successfully updated port: 02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:52:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:52:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquired lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:52:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:52:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:52:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-5a3b8358-4588-4267-b94a-534c3d8b5b17 req-7767bc5e-caf7-4cd3-9b99-01fcd0453116 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received event network-changed-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:52:30 user nova-compute[75102]: DEBUG nova.compute.manager [req-5a3b8358-4588-4267-b94a-534c3d8b5b17 req-7767bc5e-caf7-4cd3-9b99-01fcd0453116 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Refreshing instance network info cache due to event network-changed-02e11597-3b15-414d-a3d7-28d1cb89b7d7. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:52:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5a3b8358-4588-4267-b94a-534c3d8b5b17 req-7767bc5e-caf7-4cd3-9b99-01fcd0453116 service nova] Acquiring lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:52:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG nova.network.neutron [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updating instance_info_cache with network_info: [{"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Releasing lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Instance network_info: |[{"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5a3b8358-4588-4267-b94a-534c3d8b5b17 req-7767bc5e-caf7-4cd3-9b99-01fcd0453116 service nova] Acquired lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG nova.network.neutron [req-5a3b8358-4588-4267-b94a-534c3d8b5b17 req-7767bc5e-caf7-4cd3-9b99-01fcd0453116 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Refreshing network info cache for port 02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG nova.network.neutron [req-5a3b8358-4588-4267-b94a-534c3d8b5b17 req-7767bc5e-caf7-4cd3-9b99-01fcd0453116 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updated VIF entry in instance network info cache for port 02e11597-3b15-414d-a3d7-28d1cb89b7d7. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG nova.network.neutron [req-5a3b8358-4588-4267-b94a-534c3d8b5b17 req-7767bc5e-caf7-4cd3-9b99-01fcd0453116 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updating instance_info_cache with network_info: [{"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5a3b8358-4588-4267-b94a-534c3d8b5b17 req-7767bc5e-caf7-4cd3-9b99-01fcd0453116 service nova] Releasing lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:31 user nova-compute[75102]: INFO nova.compute.manager [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Detaching volume bf47cf64-fc01-4540-8617-a37b126150a1
Nov 10 16:52:31 user nova-compute[75102]: INFO nova.virt.block_device [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attempting to driver detach volume bf47cf64-fc01-4540-8617-a37b126150a1 from mountpoint /dev/vdb
Nov 10 16:52:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Attempting to detach device vdb from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:52:31 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:52:31 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:52:31 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:52:31 user nova-compute[75102]:   <serial>bf47cf64-fc01-4540-8617-a37b126150a1</serial>
Nov 10 16:52:31 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:52:31 user nova-compute[75102]: </disk>
Nov 10 16:52:31 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:52:31 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Successfully detached device vdb from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the persistent domain config.
Nov 10 16:52:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:52:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:52:31 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:52:31 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:52:31 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:52:31 user nova-compute[75102]:   <serial>bf47cf64-fc01-4540-8617-a37b126150a1</serial>
Nov 10 16:52:31 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:52:31 user nova-compute[75102]: </disk>
Nov 10 16:52:31 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:52:32 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:52:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:33 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 16:52:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:39 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:52:39 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 16:52:39 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 16:52:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:49 user nova-compute[75102]: INFO nova.compute.manager [None req-4da11042-ef16-4dfe-be08-4476fc1441e6 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Unrescuing
Nov 10 16:52:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4da11042-ef16-4dfe-be08-4476fc1441e6 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4da11042-ef16-4dfe-be08-4476fc1441e6 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquired lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4da11042-ef16-4dfe-be08-4476fc1441e6 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG nova.network.neutron [None req-4da11042-ef16-4dfe-be08-4476fc1441e6 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4da11042-ef16-4dfe-be08-4476fc1441e6 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Releasing lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG nova.objects.instance [None req-4da11042-ef16-4dfe-be08-4476fc1441e6 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'flavor' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-b69e74de-404b-4d5c-a17e-39d108da4b06 req-061cb133-63f1-42a8-90e7-af5128c6ce1d service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b69e74de-404b-4d5c-a17e-39d108da4b06 req-061cb133-63f1-42a8-90e7-af5128c6ce1d service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b69e74de-404b-4d5c-a17e-39d108da4b06 req-061cb133-63f1-42a8-90e7-af5128c6ce1d service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b69e74de-404b-4d5c-a17e-39d108da4b06 req-061cb133-63f1-42a8-90e7-af5128c6ce1d service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-b69e74de-404b-4d5c-a17e-39d108da4b06 req-061cb133-63f1-42a8-90e7-af5128c6ce1d service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:52:49 user nova-compute[75102]: WARNING nova.compute.manager [req-b69e74de-404b-4d5c-a17e-39d108da4b06 req-061cb133-63f1-42a8-90e7-af5128c6ce1d service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:52:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:50 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Instance destroyed successfully.
Nov 10 16:52:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:52:52 user nova-compute[75102]: WARNING nova.compute.manager [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:52:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:52:52 user nova-compute[75102]: WARNING nova.compute.manager [req-0af396c4-3263-49c0-b61d-6c82915a8475 req-ce2bc0e9-fe5e-4c11-a668-190a6df775d8 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:52:52 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 is timed out.
Nov 10 16:52:52 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Successfully detached device vdb from instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 from the live domain config.
Nov 10 16:52:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HBXUhdFD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:52:52 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d622abb-f51b-4cbe-bfeb-f654f7d83547]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:52:52 user nova-compute[75102]: No targets found.
Nov 10 16:52:52 user nova-compute[75102]: iSNS:
Nov 10 16:52:52 user nova-compute[75102]: No targets found.
Nov 10 16:52:52 user nova-compute[75102]: STATIC:
Nov 10 16:52:52 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f
Nov 10 16:52:52 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:52:52 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:52:52 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1
Nov 10 16:52:52 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:52:52 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:52:52 user nova-compute[75102]: FIRMWARE:
Nov 10 16:52:52 user nova-compute[75102]: No targets found.
Nov 10 16:52:52 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:52:52 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:52:52 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4cb7ecf-ebb7-42f9-a59e-892714deb2dc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a42123a7-718b-4b5f-9e18-ec901b57de52]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:52:52 user nova-compute[75102]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 (non-flash)
Nov 10 16:52:52 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:52:52 user nova-compute[75102]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 (non-flash)
Nov 10 16:52:52 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f54510d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4824d8d1-41b6-4e8e-8d4c-a783d4e3a918]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[33c9412a-6e3d-472f-aa59-9c1d737d8e05]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b76132-fef4-46e1-8b34-4253cccd5982]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9a4ecd-5698-46b2-91ae-1ea9793a5533]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9136df28-e617-4392-9ee6-1a517dd1fcb4]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1206dd4-3be8-4474-8d74-a08957a24af1]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1, portal: 172.16.0.220,3260]
Nov 10 16:52:52 user nova-compute[75102]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1, portal: 172.16.0.220,3260] successful.
Nov 10 16:52:52 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf47cf64-fc01-4540-8617-a37b126150a1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[51a3e0c4-5626-47fd-88d2-ec83bdbb677b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== disconnect_volume: return (317ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:52:52 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:52:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:53 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:52:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3712321d-5c54-40dd-885c-846023227bac tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.030s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-4da11042-ef16-4dfe-be08-4476fc1441e6 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:52:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-0f68caf1-60eb-4098-b597-43537fa0a4ab req-881ad6e6-71f0-4256-b944-163853c76356 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:52:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0f68caf1-60eb-4098-b597-43537fa0a4ab req-881ad6e6-71f0-4256-b944-163853c76356 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:52:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0f68caf1-60eb-4098-b597-43537fa0a4ab req-881ad6e6-71f0-4256-b944-163853c76356 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:52:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-0f68caf1-60eb-4098-b597-43537fa0a4ab req-881ad6e6-71f0-4256-b944-163853c76356 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:52:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-0f68caf1-60eb-4098-b597-43537fa0a4ab req-881ad6e6-71f0-4256-b944-163853c76356 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:52:54 user nova-compute[75102]: WARNING nova.compute.manager [req-0f68caf1-60eb-4098-b597-43537fa0a4ab req-881ad6e6-71f0-4256-b944-163853c76356 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state active and task_state None.
Nov 10 16:52:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:52:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:53:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:53:14 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Creating image(s)
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Did not create local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Ensure instance console log exists: /opt/stack/data/nova/instances/d816effe-bfce-48b9-b434-712fc862bb5f/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Start _get_guest_xml network_info=[{"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'attachment_id': 'f857de50-5a35-4a71-8d8d-65feeaf0bbe9', 'boot_index': 0, 'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdRwMXEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'd816effe-bfce-48b9-b434-712fc862bb5f', 'attached_at': '', 'detached_at': '', 'volume_id': 'af5e61a7-1845-4047-8359-8fef6475ef33', 'serial': 'af5e61a7-1845-4047-8359-8fef6475ef33'}, 'delete_on_termination': False, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'device_type': 'disk', 'guest_format': None, 'volume_type': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:53:14 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:53:14 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdRwMXEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:53:14 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:53:14 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:53:14 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e7074ef-0954-4a51-8ba7-47639f0b8389]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:53:14 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50d3c19-2992-4cbb-abb4-0030f21e98ec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33] added
Nov 10 16:53:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5125055c-8d61-4968-b26e-687207e8082b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80161fb-98f6-439f-b9fc-c117ea5a76fe]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdRwMXEp {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zdRwMXEp" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[29784ac2-5dbc-49c1-b199-d11564695d33]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zdRwMXEp'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b9df5d0-fc17-4807-a212-78d1ca1c411a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eff1caa-e541-4be2-bf11-f3876eb10225]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb3e654-6544-4129-8412-869ce501fea5 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:53:14 user nova-compute[75102]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb3e654-6544-4129-8412-869ce501fea5 (non-flash)
Nov 10 16:53:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:53:14 user nova-compute[75102]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb3e654-6544-4129-8412-869ce501fea5 (non-flash)
Nov 10 16:53:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6c6e747-1e5c-4061-aacc-26b80985f4ab]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33, portal: 172.16.0.220,3260]
Nov 10 16:53:14 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33, portal: 172.16.0.220,3260] successful.
Nov 10 16:53:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[069bad9e-e65c-4b4e-98d4-55e4ac831f34]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[55acf096-1a7e-419e-98e8-69c8a04c7002]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb3e654-6544-4129-8412-869ce501fea5 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:53:14 user nova-compute[75102]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb3e654-6544-4129-8412-869ce501fea5 (non-flash)
Nov 10 16:53:14 user nova-compute[75102]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)
Nov 10 16:53:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:53:14 user nova-compute[75102]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6eb3e654-6544-4129-8412-869ce501fea5 (non-flash)
Nov 10 16:53:14 user nova-compute[75102]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)
Nov 10 16:53:14 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] HCTL ('35', '-', '-', 0) found on session 47 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0430b42d-2c16-4b78-831e-1d65b436b081]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:14 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Searching for a device in session 47 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdRwMXEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.313s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '23335623665666235', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23335623665666235', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-45666079',display_name='tempest-TestVolumeBootPattern-server-45666079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-45666079',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6FiKI8yHPuMKOdaO26PxW/aCJ98TUCcCllqqiqK2tNkUCO/KNPylVTg9aOD8uUhOmWSGRMK4FoJRAe1c23FiUDj6oHLaituQ2fadfYZyJkGulZUkOdUBgbcUsOPIriQ==',key_name='tempest-TestVolumeBootPattern-796132362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-80zf02x7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:52:29Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=d816effe-bfce-48b9-b434-712fc862bb5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:2b,bridge_name='br-int',has_traffic_filtering=True,id=02e11597-3b15-414d-a3d7-28d1cb89b7d7,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e11597-3b') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.objects.instance [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'pci_devices' on Instance uuid d816effe-bfce-48b9-b434-712fc862bb5f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:53:15 user nova-compute[75102]:   <uuid>d816effe-bfce-48b9-b434-712fc862bb5f</uuid>
Nov 10 16:53:15 user nova-compute[75102]:   <name>instance-00000033</name>
Nov 10 16:53:15 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:53:15 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:53:15 user nova-compute[75102]:   <metadata>
Nov 10 16:53:15 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:53:15 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:53:15 user nova-compute[75102]:       <nova:name>tempest-TestVolumeBootPattern-server-45666079</nova:name>
Nov 10 16:53:15 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:53:14</nova:creationTime>
Nov 10 16:53:15 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:53:15 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:53:15 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:53:15 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:53:15 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:53:15 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:53:15 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:53:15 user nova-compute[75102]:       <nova:owner>
Nov 10 16:53:15 user nova-compute[75102]:         <nova:user uuid="e96544e5daa74d51a232f565129b328a">tempest-TestVolumeBootPattern-1535704831-project-member</nova:user>
Nov 10 16:53:15 user nova-compute[75102]:         <nova:project uuid="fe3cd7409a94429d9262ef8a2a664d7c">tempest-TestVolumeBootPattern-1535704831</nova:project>
Nov 10 16:53:15 user nova-compute[75102]:       </nova:owner>
Nov 10 16:53:15 user nova-compute[75102]:       <nova:ports>
Nov 10 16:53:15 user nova-compute[75102]:         <nova:port uuid="02e11597-3b15-414d-a3d7-28d1cb89b7d7">
Nov 10 16:53:15 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 10 16:53:15 user nova-compute[75102]:         </nova:port>
Nov 10 16:53:15 user nova-compute[75102]:       </nova:ports>
Nov 10 16:53:15 user nova-compute[75102]:     </nova:instance>
Nov 10 16:53:15 user nova-compute[75102]:   </metadata>
Nov 10 16:53:15 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:53:15 user nova-compute[75102]:     <system>
Nov 10 16:53:15 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:53:15 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:53:15 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:53:15 user nova-compute[75102]:       <entry name="serial">d816effe-bfce-48b9-b434-712fc862bb5f</entry>
Nov 10 16:53:15 user nova-compute[75102]:       <entry name="uuid">d816effe-bfce-48b9-b434-712fc862bb5f</entry>
Nov 10 16:53:15 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:53:15 user nova-compute[75102]:     </system>
Nov 10 16:53:15 user nova-compute[75102]:   </sysinfo>
Nov 10 16:53:15 user nova-compute[75102]:   <os>
Nov 10 16:53:15 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:53:15 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:53:15 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:53:15 user nova-compute[75102]:   </os>
Nov 10 16:53:15 user nova-compute[75102]:   <features>
Nov 10 16:53:15 user nova-compute[75102]:     <acpi/>
Nov 10 16:53:15 user nova-compute[75102]:     <apic/>
Nov 10 16:53:15 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:53:15 user nova-compute[75102]:   </features>
Nov 10 16:53:15 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:53:15 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:53:15 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:53:15 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:53:15 user nova-compute[75102]:   </clock>
Nov 10 16:53:15 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:53:15 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:53:15 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:53:15 user nova-compute[75102]:   </cpu>
Nov 10 16:53:15 user nova-compute[75102]:   <devices>
Nov 10 16:53:15 user nova-compute[75102]:     <disk type="block" device="disk">
Nov 10 16:53:15 user nova-compute[75102]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:53:15 user nova-compute[75102]:       <source dev="/dev/sdd"/>
Nov 10 16:53:15 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:53:15 user nova-compute[75102]:       <serial>af5e61a7-1845-4047-8359-8fef6475ef33</serial>
Nov 10 16:53:15 user nova-compute[75102]:     </disk>
Nov 10 16:53:15 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:53:15 user nova-compute[75102]:       <mac address="fa:16:3e:71:c6:2b"/>
Nov 10 16:53:15 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:53:15 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:53:15 user nova-compute[75102]:       <target dev="tap02e11597-3b"/>
Nov 10 16:53:15 user nova-compute[75102]:     </interface>
Nov 10 16:53:15 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:53:15 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/d816effe-bfce-48b9-b434-712fc862bb5f/console.log" append="off"/>
Nov 10 16:53:15 user nova-compute[75102]:     </serial>
Nov 10 16:53:15 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:53:15 user nova-compute[75102]:     <video>
Nov 10 16:53:15 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:53:15 user nova-compute[75102]:     </video>
Nov 10 16:53:15 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:53:15 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:53:15 user nova-compute[75102]:     </rng>
Nov 10 16:53:15 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:53:15 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:53:15 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:53:15 user nova-compute[75102]:     </memballoon>
Nov 10 16:53:15 user nova-compute[75102]:   </devices>
Nov 10 16:53:15 user nova-compute[75102]: </domain>
Nov 10 16:53:15 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-45666079',display_name='tempest-TestVolumeBootPattern-server-45666079',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-45666079',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6FiKI8yHPuMKOdaO26PxW/aCJ98TUCcCllqqiqK2tNkUCO/KNPylVTg9aOD8uUhOmWSGRMK4FoJRAe1c23FiUDj6oHLaituQ2fadfYZyJkGulZUkOdUBgbcUsOPIriQ==',key_name='tempest-TestVolumeBootPattern-796132362',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-80zf02x7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:52:29Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=d816effe-bfce-48b9-b434-712fc862bb5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:2b,bridge_name='br-int',has_traffic_filtering=True,id=02e11597-3b15-414d-a3d7-28d1cb89b7d7,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e11597-3b') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG os_vif [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:2b,bridge_name='br-int',has_traffic_filtering=True,id=02e11597-3b15-414d-a3d7-28d1cb89b7d7,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e11597-3b') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f7010ce5-2221-5252-b58c-3248239cf877', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap02e11597-3b, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap02e11597-3b, col_values=(('qos', UUID('a7563ad4-585c-4152-926c-0be5165e1351')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap02e11597-3b, col_values=(('external_ids', {'iface-id': '02e11597-3b15-414d-a3d7-28d1cb89b7d7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:71:c6:2b', 'vm-uuid': 'd816effe-bfce-48b9-b434-712fc862bb5f'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:15 user nova-compute[75102]: INFO os_vif [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:71:c6:2b,bridge_name='br-int',has_traffic_filtering=True,id=02e11597-3b15-414d-a3d7-28d1cb89b7d7,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e11597-3b')
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] No VIF found with MAC fa:16:3e:71:c6:2b, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:53:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-257f753c-5f81-4095-9022-90d8d0332ba1 req-917cd697-e263-4645-a41f-e642af575366 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received event network-vif-plugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-257f753c-5f81-4095-9022-90d8d0332ba1 req-917cd697-e263-4645-a41f-e642af575366 service nova] Acquiring lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-257f753c-5f81-4095-9022-90d8d0332ba1 req-917cd697-e263-4645-a41f-e642af575366 service nova] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-257f753c-5f81-4095-9022-90d8d0332ba1 req-917cd697-e263-4645-a41f-e642af575366 service nova] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG nova.compute.manager [req-257f753c-5f81-4095-9022-90d8d0332ba1 req-917cd697-e263-4645-a41f-e642af575366 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] No waiting events found dispatching network-vif-plugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:53:17 user nova-compute[75102]: WARNING nova.compute.manager [req-257f753c-5f81-4095-9022-90d8d0332ba1 req-917cd697-e263-4645-a41f-e642af575366 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received unexpected event network-vif-plugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 for instance with vm_state building and task_state spawning.
Nov 10 16:53:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:17 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:53:19 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Instance spawned successfully.
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:53:19 user nova-compute[75102]: INFO nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Took 5.00 seconds to spawn the instance on the hypervisor.
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-142a04ba-d7a1-4713-97c5-85e5cb820e88 req-cc68dc5e-9625-4dea-8ddc-a4ea8ac35d90 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received event network-vif-plugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-142a04ba-d7a1-4713-97c5-85e5cb820e88 req-cc68dc5e-9625-4dea-8ddc-a4ea8ac35d90 service nova] Acquiring lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-142a04ba-d7a1-4713-97c5-85e5cb820e88 req-cc68dc5e-9625-4dea-8ddc-a4ea8ac35d90 service nova] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-142a04ba-d7a1-4713-97c5-85e5cb820e88 req-cc68dc5e-9625-4dea-8ddc-a4ea8ac35d90 service nova] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.compute.manager [req-142a04ba-d7a1-4713-97c5-85e5cb820e88 req-cc68dc5e-9625-4dea-8ddc-a4ea8ac35d90 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] No waiting events found dispatching network-vif-plugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:53:19 user nova-compute[75102]: WARNING nova.compute.manager [req-142a04ba-d7a1-4713-97c5-85e5cb820e88 req-cc68dc5e-9625-4dea-8ddc-a4ea8ac35d90 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received unexpected event network-vif-plugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 for instance with vm_state building and task_state spawning.
Nov 10 16:53:19 user nova-compute[75102]: INFO nova.compute.manager [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Took 50.86 seconds to build instance.
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-8882c610-7d1d-4641-8d47-91964bf35b74 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "d816effe-bfce-48b9-b434-712fc862bb5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 50.975s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:19 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.231s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.204s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:22 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:53:22 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8189MB free_disk=25.01949691772461GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1eed0b35-1df9-442f-a467-68afaec4db3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d816effe-bfce-48b9-b434-712fc862bb5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:53:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.433s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:23 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:53:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:53:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:53:23 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:53:23 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updating instance_info_cache with network_info: [{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:53:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:53:24 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:53:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:24 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:53:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG nova.objects.instance [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'flavor' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:28 user nova-compute[75102]: INFO nova.compute.manager [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Attaching volume e9cadab1-b87c-468a-80b2-8c9017254ee7 to /dev/vdb
Nov 10 16:53:28 user nova-compute[75102]: DEBUG os_brick.utils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8daf7d-e309-4ca0-acef-1e3b124aa062]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ccc7cf-2d31-445e-b99a-4d525e38f9d3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c01e3c30-097d-44b7-ba70-3ff4d12f525a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[df08c7f7-2b11-4edb-bc67-6123dad979d4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:53:28 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:53:28 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[beec83a1-d7c8-456b-b238-a94e9a689981]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG os_brick.utils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:53:28 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating existing volume attachment record: 088b6a46-b112-4950-ac98-a02ba1fa850d {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:53:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid d70f5eeb-42bd-4612-8103-9e5bc8950cea {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 1eed0b35-1df9-442f-a467-68afaec4db3a {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid d816effe-bfce-48b9-b434-712fc862bb5f {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "1eed0b35-1df9-442f-a467-68afaec4db3a" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "d816effe-bfce-48b9-b434-712fc862bb5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "d816effe-bfce-48b9-b434-712fc862bb5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.047s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.051s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "d816effe-bfce-48b9-b434-712fc862bb5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.059s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.067s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.volume.cinder [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Update attachment failed for attachment 088b6a46-b112-4950-ac98-a02ba1fa850d. Error: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bb62ebc4-f0c9-4900-a11a-226b5d83abf0) Code: 500: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bb62ebc4-f0c9-4900-a11a-226b5d83abf0)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Failed to attach e9cadab1-b87c-468a-80b2-8c9017254ee7 at /dev/vdb: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bb62ebc4-f0c9-4900-a11a-226b5d83abf0)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Traceback (most recent call last):
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     self._volume_attach(context, volume, connector, instance,
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     connection_info = volume_api.attachment_update(
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     res = method(self, ctx, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     with excutils.save_and_reraise_exception():
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     self.force_reraise()
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     raise self.value
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     return method.func(obj, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     return self.request(url, method, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5]     raise exceptions.from_response(resp, body)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bb62ebc4-f0c9-4900-a11a-226b5d83abf0)
Nov 10 16:53:53 user nova-compute[75102]: ERROR nova.compute.manager [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] 
Nov 10 16:53:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.902s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.668s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:53:53 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.164s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server [None req-63395a0e-fdb9-42bf-8f2c-d3336c2156dd tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Exception during message handling: cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bb62ebc4-f0c9-4900-a11a-226b5d83abf0)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/utils.py", line 1439, in decorated_function
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 213, in decorated_function
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 203, in decorated_function
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return function(self, context, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7553, in attach_volume
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     do_attach_volume(context, instance, driver_bdm)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py", line 414, in inner
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return f(*args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7550, in do_attach_volume
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7548, in do_attach_volume
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._attach_volume(context, instance, driver_bdm)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7570, in _attach_volume
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 7567, in _attach_volume
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     bdm.attach(context, instance, self.volume_api, self.driver,
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 46, in wrapped
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     ret_val = method(obj, context, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 734, in attach
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._do_attach(context, instance, volume, volume_api,
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 719, in _do_attach
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self._volume_attach(context, volume, connector, instance,
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/block_device.py", line 633, in _volume_attach
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     connection_info = volume_api.attachment_update(
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 451, in wrapper
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     res = method(self, ctx, attachment_id, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 915, in attachment_update
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/volume/cinder.py", line 909, in attachment_update
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     context, '3.44', skip_version_check=True).attachments.update(
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/api_versions.py", line 421, in substitution
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return method.func(obj, *args, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/attachments.py", line 75, in update
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp = self._update('/attachments/%s' % id, body)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/base.py", line 318, in _update
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     resp, body = self.api.client.put(url, body=body, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 226, in put
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self._cs_request(url, 'PUT', **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     return self.request(url, method, **kwargs)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server     raise exceptions.from_response(resp, body)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server cinderclient.exceptions.ClientException: Unable to update attachment.(Bad or unexpected response from the storage volume backend API: Create export for volume failed (Volume driver reported an error: None).). (HTTP 500) (Request-ID: req-bb62ebc4-f0c9-4900-a11a-226b5d83abf0)
Nov 10 16:53:53 user nova-compute[75102]: ERROR oslo_messaging.rpc.server 
Nov 10 16:53:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:54:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-660b156b-25b3-4014-bb69-7da485272cb8 req-50cd18eb-5590-4373-93ab-468c2b52c48c service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received event network-changed-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:54:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-660b156b-25b3-4014-bb69-7da485272cb8 req-50cd18eb-5590-4373-93ab-468c2b52c48c service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Refreshing instance network info cache due to event network-changed-bd64bf27-431c-4a0f-8999-53df16ea62d7. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:54:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-660b156b-25b3-4014-bb69-7da485272cb8 req-50cd18eb-5590-4373-93ab-468c2b52c48c service nova] Acquiring lock "refresh_cache-9c68c3b1-4586-49f4-9042-c4ef622b1638" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:54:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-660b156b-25b3-4014-bb69-7da485272cb8 req-50cd18eb-5590-4373-93ab-468c2b52c48c service nova] Acquired lock "refresh_cache-9c68c3b1-4586-49f4-9042-c4ef622b1638" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:54:06 user nova-compute[75102]: DEBUG nova.network.neutron [req-660b156b-25b3-4014-bb69-7da485272cb8 req-50cd18eb-5590-4373-93ab-468c2b52c48c service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Refreshing network info cache for port bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-660b156b-25b3-4014-bb69-7da485272cb8 req-50cd18eb-5590-4373-93ab-468c2b52c48c service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Updated VIF entry in instance network info cache for port bd64bf27-431c-4a0f-8999-53df16ea62d7. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG nova.network.neutron [req-660b156b-25b3-4014-bb69-7da485272cb8 req-50cd18eb-5590-4373-93ab-468c2b52c48c service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Updating instance_info_cache with network_info: [{"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-660b156b-25b3-4014-bb69-7da485272cb8 req-50cd18eb-5590-4373-93ab-468c2b52c48c service nova] Releasing lock "refresh_cache-9c68c3b1-4586-49f4-9042-c4ef622b1638" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lazy-loading 'flavor' on Instance uuid 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.055s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:07 user nova-compute[75102]: INFO nova.compute.manager [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Attaching volume 58b5c829-d2d5-4e7c-9e19-e188e598bce0 to /dev/vdb
Nov 10 16:54:07 user nova-compute[75102]: DEBUG os_brick.utils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae5f2d20-ad54-46fb-a462-18e531806c20]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ff669d-b3d8-4f13-a6e2-c4a368131487]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[588998d9-322a-4697-ab58-9ee23f950740]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[730610b9-e1f6-49d4-874e-9e20b6dd8acf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:54:07 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:54:07 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0d510c6-7483-43ca-bd48-5da0713e6bf3]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG os_brick.utils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:54:07 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Updating existing volume attachment record: 9ca06bc9-e1c9-400d-80af-2a0bc44e88fe {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:54:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:18 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:54:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:22 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:54:22 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:54:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8199MB free_disk=25.017173767089844GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1eed0b35-1df9-442f-a467-68afaec4db3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d816effe-bfce-48b9-b434-712fc862bb5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:54:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:54:23 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:54:23 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:54:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:54:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updating instance_info_cache with network_info: [{"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:54:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:26 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:26 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:27 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:54:30 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTJHdpEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:54:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:54:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:54:31 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:54:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:54:31 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:54:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec1953b0-a1a0-464a-988e-48a0d3928249]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:54:31 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0f9c28-4617-472d-ad63-9a028616df2e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0] added
Nov 10 16:54:31 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:54:31 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.037s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b7ea05-fbc5-47f7-8a0c-1d9a14d5deb3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eff4593-ffbf-454e-a80f-8be71338efba]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTJHdpEw {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bTJHdpEw" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[586005bd-899a-42e9-861d-7a28500e1422]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bTJHdpEw'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e5eb8b-74dc-4abb-82b3-07fe72c57057]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[37bb68e9-cbcc-465e-9307-ccd2619b0069]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:54:32 user nova-compute[75102]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)
Nov 10 16:54:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:54:32 user nova-compute[75102]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)
Nov 10 16:54:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[546cef8b-f43c-4697-be8f-061653ff39da]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0, portal: 172.16.0.220,3260]
Nov 10 16:54:32 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0, portal: 172.16.0.220,3260] successful.
Nov 10 16:54:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d84631b-84b4-462e-bc8e-e428c5c7d678]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b64d24-6646-472a-adec-dd73583fa185]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:54:32 user nova-compute[75102]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)
Nov 10 16:54:32 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:54:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:54:32 user nova-compute[75102]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)
Nov 10 16:54:32 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:54:32 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[835832f6-0c2c-4377-87cd-2c6f6a2226d5]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:32 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: None {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTJHdpEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.326s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '26266346361636264', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266346361636264', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG nova.objects.instance [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lazy-loading 'flavor' on Instance uuid 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:54:33 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:54:33 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:54:33 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:54:33 user nova-compute[75102]:   <serial>58b5c829-d2d5-4e7c-9e19-e188e598bce0</serial>
Nov 10 16:54:33 user nova-compute[75102]: </disk>
Nov 10 16:54:33 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] No VIF found with MAC fa:16:3e:2f:53:1d, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:54:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-4e24f476-cc96-422a-98a1-fdb4336d8472 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 26.133s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lazy-loading 'flavor' on Instance uuid 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:37 user nova-compute[75102]: INFO nova.compute.manager [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Attaching volume 922564e6-6e0f-47e9-a1b0-f5e652d6b679 to /dev/vdc
Nov 10 16:54:37 user nova-compute[75102]: DEBUG os_brick.utils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e87f88-2800-4e13-b1de-55ad59e95c92]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[48cc618f-bf04-446d-a4bf-44b0b29d09cb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2613e7-dc80-4fc4-a953-34b0df5727ee]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a147754-c5a8-49b5-8646-6a7021ea790d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:54:37 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:54:37 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[da112804-3e7e-4455-b3eb-274bcad77728]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG os_brick.utils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:54:37 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Updating existing volume attachment record: 5dee8a50-7439-4f7a-b19c-d123fa883daa {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:54:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Starting instance... {{(pid=75102) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75102) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 10 16:54:48 user nova-compute[75102]: INFO nova.compute.claims [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Claim successful on node user
Nov 10 16:54:48 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.344s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Start building networks asynchronously for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Allocating IP information in the background. {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 10 16:54:48 user nova-compute[75102]: DEBUG nova.network.neutron [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] allocate_for_instance() {{(pid=75102) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 10 16:54:48 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 10 16:54:48 user nova-compute[75102]: DEBUG nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Start building block device mappings for instance. {{(pid=75102) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG nova.policy [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cd7ddbca327e4e2893563e02cd3d3754', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea704446109948239b67b37c01c2c146', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75102) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Start spawning the instance on the hypervisor. {{(pid=75102) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Creating instance directory {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 10 16:54:49 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Creating image(s)
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.218s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk 1073741824 {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk 1073741824" returned: 0 in 0.054s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.278s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.183s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk. size=1073741824 {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG nova.network.neutron [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Successfully created port: 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG nova.virt.disk.api [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Cannot resize image /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk to a smaller size. {{(pid=75102) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Ensure instance console log exists: /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/console.log {{(pid=75102) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:50 user nova-compute[75102]: DEBUG nova.network.neutron [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Successfully updated port: 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 10 16:54:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:54:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquired lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:54:50 user nova-compute[75102]: DEBUG nova.network.neutron [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:54:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-d55e118b-4829-46f2-8b09-c11f02b49e88 req-d2f493a9-0cc2-4e6f-bbbc-14558f6a0f2f service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-changed-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:54:50 user nova-compute[75102]: DEBUG nova.compute.manager [req-d55e118b-4829-46f2-8b09-c11f02b49e88 req-d2f493a9-0cc2-4e6f-bbbc-14558f6a0f2f service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Refreshing instance network info cache due to event network-changed-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:54:50 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d55e118b-4829-46f2-8b09-c11f02b49e88 req-d2f493a9-0cc2-4e6f-bbbc-14558f6a0f2f service nova] Acquiring lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:54:50 user nova-compute[75102]: DEBUG nova.network.neutron [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Instance cache missing network info. {{(pid=75102) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.network.neutron [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Releasing lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Instance network_info: |[{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75102) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d55e118b-4829-46f2-8b09-c11f02b49e88 req-d2f493a9-0cc2-4e6f-bbbc-14558f6a0f2f service nova] Acquired lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.network.neutron [req-d55e118b-4829-46f2-8b09-c11f02b49e88 req-d2f493a9-0cc2-4e6f-bbbc-14558f6a0f2f service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Refreshing network info cache for port 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Start _get_guest_xml network_info=[{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'boot_index': 0, 'disk_bus': 'virtio', 'encryption_format': None, 'encrypted': False, 'size': 0, 'device_type': 'disk', 'guest_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'encryption_options': None, 'image_id': 'a26f5e2e-1666-4272-b064-065539894418'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:54:51 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:54:51 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1770642413',display_name='tempest-ServerRescueNegativeTestJSON-server-1770642413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1770642413',id=52,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMXtOBIgEpFHGQuo9Gj11BIKfbDZECAdmouNryZL79YX1sTu6Dy+EnPTXL60WtAyNV0nrLJnO119tFrIdluOcy+8GhV+u6aEnuulBFfk0z+3DNKmD5fUJla9GkPR7Zc2g==',key_name='tempest-keypair-1195217145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-u3ko2vcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=c9fc7541-3321-4340-830f-c73af84d428b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e0148c0-ca8c-442f-9b7f-e7b063fefb7e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0148c0-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.objects.instance [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'pci_devices' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:54:51 user nova-compute[75102]:   <uuid>c9fc7541-3321-4340-830f-c73af84d428b</uuid>
Nov 10 16:54:51 user nova-compute[75102]:   <name>instance-00000034</name>
Nov 10 16:54:51 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:54:51 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:54:51 user nova-compute[75102]:   <metadata>
Nov 10 16:54:51 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:54:51 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:54:51 user nova-compute[75102]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1770642413</nova:name>
Nov 10 16:54:51 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:54:51</nova:creationTime>
Nov 10 16:54:51 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:54:51 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:54:51 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:54:51 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:54:51 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:54:51 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:54:51 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:54:51 user nova-compute[75102]:       <nova:owner>
Nov 10 16:54:51 user nova-compute[75102]:         <nova:user uuid="cd7ddbca327e4e2893563e02cd3d3754">tempest-ServerRescueNegativeTestJSON-662150154-project-member</nova:user>
Nov 10 16:54:51 user nova-compute[75102]:         <nova:project uuid="ea704446109948239b67b37c01c2c146">tempest-ServerRescueNegativeTestJSON-662150154</nova:project>
Nov 10 16:54:51 user nova-compute[75102]:       </nova:owner>
Nov 10 16:54:51 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:54:51 user nova-compute[75102]:       <nova:ports>
Nov 10 16:54:51 user nova-compute[75102]:         <nova:port uuid="3e0148c0-ca8c-442f-9b7f-e7b063fefb7e">
Nov 10 16:54:51 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 16:54:51 user nova-compute[75102]:         </nova:port>
Nov 10 16:54:51 user nova-compute[75102]:       </nova:ports>
Nov 10 16:54:51 user nova-compute[75102]:     </nova:instance>
Nov 10 16:54:51 user nova-compute[75102]:   </metadata>
Nov 10 16:54:51 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:54:51 user nova-compute[75102]:     <system>
Nov 10 16:54:51 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:54:51 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:54:51 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:54:51 user nova-compute[75102]:       <entry name="serial">c9fc7541-3321-4340-830f-c73af84d428b</entry>
Nov 10 16:54:51 user nova-compute[75102]:       <entry name="uuid">c9fc7541-3321-4340-830f-c73af84d428b</entry>
Nov 10 16:54:51 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:54:51 user nova-compute[75102]:     </system>
Nov 10 16:54:51 user nova-compute[75102]:   </sysinfo>
Nov 10 16:54:51 user nova-compute[75102]:   <os>
Nov 10 16:54:51 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:54:51 user nova-compute[75102]:     <boot dev="hd"/>
Nov 10 16:54:51 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:54:51 user nova-compute[75102]:   </os>
Nov 10 16:54:51 user nova-compute[75102]:   <features>
Nov 10 16:54:51 user nova-compute[75102]:     <acpi/>
Nov 10 16:54:51 user nova-compute[75102]:     <apic/>
Nov 10 16:54:51 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:54:51 user nova-compute[75102]:   </features>
Nov 10 16:54:51 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:54:51 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:54:51 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:54:51 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:54:51 user nova-compute[75102]:   </clock>
Nov 10 16:54:51 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:54:51 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:54:51 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:54:51 user nova-compute[75102]:   </cpu>
Nov 10 16:54:51 user nova-compute[75102]:   <devices>
Nov 10 16:54:51 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:54:51 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:54:51 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk"/>
Nov 10 16:54:51 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:54:51 user nova-compute[75102]:     </disk>
Nov 10 16:54:51 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:54:51 user nova-compute[75102]:       <mac address="fa:16:3e:d1:9d:1b"/>
Nov 10 16:54:51 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:54:51 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:54:51 user nova-compute[75102]:       <target dev="tap3e0148c0-ca"/>
Nov 10 16:54:51 user nova-compute[75102]:     </interface>
Nov 10 16:54:51 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:54:51 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/console.log" append="off"/>
Nov 10 16:54:51 user nova-compute[75102]:     </serial>
Nov 10 16:54:51 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:54:51 user nova-compute[75102]:     <video>
Nov 10 16:54:51 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:54:51 user nova-compute[75102]:     </video>
Nov 10 16:54:51 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:54:51 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:54:51 user nova-compute[75102]:     </rng>
Nov 10 16:54:51 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:54:51 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:54:51 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:54:51 user nova-compute[75102]:     </memballoon>
Nov 10 16:54:51 user nova-compute[75102]:   </devices>
Nov 10 16:54:51 user nova-compute[75102]: </domain>
Nov 10 16:54:51 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1770642413',display_name='tempest-ServerRescueNegativeTestJSON-server-1770642413',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1770642413',id=52,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMXtOBIgEpFHGQuo9Gj11BIKfbDZECAdmouNryZL79YX1sTu6Dy+EnPTXL60WtAyNV0nrLJnO119tFrIdluOcy+8GhV+u6aEnuulBFfk0z+3DNKmD5fUJla9GkPR7Zc2g==',key_name='tempest-keypair-1195217145',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-u3ko2vcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:54:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=c9fc7541-3321-4340-830f-c73af84d428b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e0148c0-ca8c-442f-9b7f-e7b063fefb7e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0148c0-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG os_vif [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e0148c0-ca8c-442f-9b7f-e7b063fefb7e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0148c0-ca') {{(pid=75102) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2e3e06d-f5a5-582b-ae6b-b4602fd4a405', '_type': 'linux-noop'}}, row=False) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3e0148c0-ca, may_exist=True, interface_attrs={}) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3e0148c0-ca, col_values=(('qos', UUID('b6efca50-df3a-481a-94a7-dc375d915ab7')),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3e0148c0-ca, col_values=(('external_ids', {'iface-id': '3e0148c0-ca8c-442f-9b7f-e7b063fefb7e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:9d:1b', 'vm-uuid': 'c9fc7541-3321-4340-830f-c73af84d428b'}),), if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:51 user nova-compute[75102]: INFO os_vif [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e0148c0-ca8c-442f-9b7f-e7b063fefb7e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0148c0-ca')
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No VIF found with MAC fa:16:3e:d1:9d:1b, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.network.neutron [req-d55e118b-4829-46f2-8b09-c11f02b49e88 req-d2f493a9-0cc2-4e6f-bbbc-14558f6a0f2f service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updated VIF entry in instance network info cache for port 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG nova.network.neutron [req-d55e118b-4829-46f2-8b09-c11f02b49e88 req-d2f493a9-0cc2-4e6f-bbbc-14558f6a0f2f service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:54:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d55e118b-4829-46f2-8b09-c11f02b49e88 req-d2f493a9-0cc2-4e6f-bbbc-14558f6a0f2f service nova] Releasing lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-2875edb6-60c0-45cd-9894-f708a73d914f req-15382019-8392-4883-86c1-2c501723a4a0 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2875edb6-60c0-45cd-9894-f708a73d914f req-15382019-8392-4883-86c1-2c501723a4a0 service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2875edb6-60c0-45cd-9894-f708a73d914f req-15382019-8392-4883-86c1-2c501723a4a0 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2875edb6-60c0-45cd-9894-f708a73d914f req-15382019-8392-4883-86c1-2c501723a4a0 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:52 user nova-compute[75102]: DEBUG nova.compute.manager [req-2875edb6-60c0-45cd-9894-f708a73d914f req-15382019-8392-4883-86c1-2c501723a4a0 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:54:52 user nova-compute[75102]: WARNING nova.compute.manager [req-2875edb6-60c0-45cd-9894-f708a73d914f req-15382019-8392-4883-86c1-2c501723a4a0 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state building and task_state spawning.
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Instance event wait completed in 0 seconds for  {{(pid=75102) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Guest created on hypervisor {{(pid=75102) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 10 16:54:54 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Instance spawned successfully.
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Found default for hw_cdrom_bus of ide {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Found default for hw_disk_bus of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Found default for hw_input_bus of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Found default for hw_pointer_model of None {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Found default for hw_video_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Found default for hw_vif_model of virtio {{(pid=75102) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 10 16:54:54 user nova-compute[75102]: INFO nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Took 5.85 seconds to spawn the instance on the hypervisor.
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-4298617e-efc4-4232-8674-045a840fa50d req-e52f4f53-2c25-4087-8e2f-3d26fc459a69 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4298617e-efc4-4232-8674-045a840fa50d req-e52f4f53-2c25-4087-8e2f-3d26fc459a69 service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4298617e-efc4-4232-8674-045a840fa50d req-e52f4f53-2c25-4087-8e2f-3d26fc459a69 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4298617e-efc4-4232-8674-045a840fa50d req-e52f4f53-2c25-4087-8e2f-3d26fc459a69 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:54 user nova-compute[75102]: DEBUG nova.compute.manager [req-4298617e-efc4-4232-8674-045a840fa50d req-e52f4f53-2c25-4087-8e2f-3d26fc459a69 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:54:54 user nova-compute[75102]: WARNING nova.compute.manager [req-4298617e-efc4-4232-8674-045a840fa50d req-e52f4f53-2c25-4087-8e2f-3d26fc459a69 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state building and task_state spawning.
Nov 10 16:54:55 user nova-compute[75102]: INFO nova.compute.manager [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Took 6.56 seconds to build instance.
Nov 10 16:54:55 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-81cb8eec-db33-4fc5-bc51-5a642362de67 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.659s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:54:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:54:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:55:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-5778c109-372a-4c42-a3e7-f47b45d39694 req-d229b79f-8a27-4acb-ac2f-e8812b26b0c7 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received event network-changed-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:55:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-5778c109-372a-4c42-a3e7-f47b45d39694 req-d229b79f-8a27-4acb-ac2f-e8812b26b0c7 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Refreshing instance network info cache due to event network-changed-02e11597-3b15-414d-a3d7-28d1cb89b7d7. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:55:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5778c109-372a-4c42-a3e7-f47b45d39694 req-d229b79f-8a27-4acb-ac2f-e8812b26b0c7 service nova] Acquiring lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:55:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5778c109-372a-4c42-a3e7-f47b45d39694 req-d229b79f-8a27-4acb-ac2f-e8812b26b0c7 service nova] Acquired lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:55:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-5778c109-372a-4c42-a3e7-f47b45d39694 req-d229b79f-8a27-4acb-ac2f-e8812b26b0c7 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Refreshing network info cache for port 02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:55:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-5778c109-372a-4c42-a3e7-f47b45d39694 req-d229b79f-8a27-4acb-ac2f-e8812b26b0c7 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updated VIF entry in instance network info cache for port 02e11597-3b15-414d-a3d7-28d1cb89b7d7. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:55:10 user nova-compute[75102]: DEBUG nova.network.neutron [req-5778c109-372a-4c42-a3e7-f47b45d39694 req-d229b79f-8a27-4acb-ac2f-e8812b26b0c7 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updating instance_info_cache with network_info: [{"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:55:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5778c109-372a-4c42-a3e7-f47b45d39694 req-d229b79f-8a27-4acb-ac2f-e8812b26b0c7 service nova] Releasing lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:55:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-54d0c42e-489d-4bf5-97fa-978d45c6b7e5 req-a66daa16-9a31-4fb8-9298-26af2680119b service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received event network-changed-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG nova.compute.manager [req-54d0c42e-489d-4bf5-97fa-978d45c6b7e5 req-a66daa16-9a31-4fb8-9298-26af2680119b service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Refreshing instance network info cache due to event network-changed-02e11597-3b15-414d-a3d7-28d1cb89b7d7. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-54d0c42e-489d-4bf5-97fa-978d45c6b7e5 req-a66daa16-9a31-4fb8-9298-26af2680119b service nova] Acquiring lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-54d0c42e-489d-4bf5-97fa-978d45c6b7e5 req-a66daa16-9a31-4fb8-9298-26af2680119b service nova] Acquired lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG nova.network.neutron [req-54d0c42e-489d-4bf5-97fa-978d45c6b7e5 req-a66daa16-9a31-4fb8-9298-26af2680119b service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Refreshing network info cache for port 02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "d816effe-bfce-48b9-b434-712fc862bb5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "d816effe-bfce-48b9-b434-712fc862bb5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:55:11 user nova-compute[75102]: INFO nova.compute.manager [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Terminating instance
Nov 10 16:55:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-62419f9c-a0f1-43d5-bffe-cadcf74490c8 req-28764ed2-e00b-40a1-9ac5-a46ff2674ee4 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received event network-vif-unplugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-62419f9c-a0f1-43d5-bffe-cadcf74490c8 req-28764ed2-e00b-40a1-9ac5-a46ff2674ee4 service nova] Acquiring lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-62419f9c-a0f1-43d5-bffe-cadcf74490c8 req-28764ed2-e00b-40a1-9ac5-a46ff2674ee4 service nova] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-62419f9c-a0f1-43d5-bffe-cadcf74490c8 req-28764ed2-e00b-40a1-9ac5-a46ff2674ee4 service nova] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-62419f9c-a0f1-43d5-bffe-cadcf74490c8 req-28764ed2-e00b-40a1-9ac5-a46ff2674ee4 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] No waiting events found dispatching network-vif-unplugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.compute.manager [req-62419f9c-a0f1-43d5-bffe-cadcf74490c8 req-28764ed2-e00b-40a1-9ac5-a46ff2674ee4 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received event network-vif-unplugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-54d0c42e-489d-4bf5-97fa-978d45c6b7e5 req-a66daa16-9a31-4fb8-9298-26af2680119b service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updated VIF entry in instance network info cache for port 02e11597-3b15-414d-a3d7-28d1cb89b7d7. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.network.neutron [req-54d0c42e-489d-4bf5-97fa-978d45c6b7e5 req-a66daa16-9a31-4fb8-9298-26af2680119b service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updating instance_info_cache with network_info: [{"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-54d0c42e-489d-4bf5-97fa-978d45c6b7e5 req-a66daa16-9a31-4fb8-9298-26af2680119b service nova] Releasing lock "refresh_cache-d816effe-bfce-48b9-b434-712fc862bb5f" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Instance destroyed successfully.
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.objects.instance [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'resources' on Instance uuid d816effe-bfce-48b9-b434-712fc862bb5f {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:52:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-45666079',display_name='tempest-TestVolumeBootPattern-server-45666079',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-45666079',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6FiKI8yHPuMKOdaO26PxW/aCJ98TUCcCllqqiqK2tNkUCO/KNPylVTg9aOD8uUhOmWSGRMK4FoJRAe1c23FiUDj6oHLaituQ2fadfYZyJkGulZUkOdUBgbcUsOPIriQ==',key_name='tempest-TestVolumeBootPattern-796132362',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:53:19Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-80zf02x7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:53:19Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=d816effe-bfce-48b9-b434-712fc862bb5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "address": "fa:16:3e:71:c6:2b", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.24", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap02e11597-3b", "ovs_interfaceid": "02e11597-3b15-414d-a3d7-28d1cb89b7d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:71:c6:2b,bridge_name='br-int',has_traffic_filtering=True,id=02e11597-3b15-414d-a3d7-28d1cb89b7d7,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e11597-3b') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_vif [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:c6:2b,bridge_name='br-int',has_traffic_filtering=True,id=02e11597-3b15-414d-a3d7-28d1cb89b7d7,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e11597-3b') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap02e11597-3b, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a7563ad4-585c-4152-926c-0be5165e1351) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:55:12 user nova-compute[75102]: INFO os_vif [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:71:c6:2b,bridge_name='br-int',has_traffic_filtering=True,id=02e11597-3b15-414d-a3d7-28d1cb89b7d7,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap02e11597-3b')
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zdRwMXEp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:55:12 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebc8e0b-145f-4b49-9dd1-2387085372c9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:55:12 user nova-compute[75102]: No targets found.
Nov 10 16:55:12 user nova-compute[75102]: iSNS:
Nov 10 16:55:12 user nova-compute[75102]: No targets found.
Nov 10 16:55:12 user nova-compute[75102]: STATIC:
Nov 10 16:55:12 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33
Nov 10 16:55:12 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:55:12 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:55:12 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f
Nov 10 16:55:12 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:55:12 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:55:12 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0
Nov 10 16:55:12 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:55:12 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:55:12 user nova-compute[75102]: FIRMWARE:
Nov 10 16:55:12 user nova-compute[75102]: No targets found.
Nov 10 16:55:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:55:12 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:55:12 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6d61f1-b61a-4620-a008-fe380f455b80]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc195e66-febe-49d4-9c30-88dcd40cd030]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:55:12 user nova-compute[75102]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)
Nov 10 16:55:12 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:55:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:55:12 user nova-compute[75102]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 (non-flash)
Nov 10 16:55:12 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:55:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f5446d090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[127beff2-6b48-4320-95d1-0350dd66a1cf]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e49c490a-c147-41bd-9279-fe0c1631d462]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[121446fe-c498-431d-96c4-388b1246f665]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.049s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[160efbd4-9c03-468f-820a-65f110b1f9a0]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3749b5-629c-4489-ba81-a5d6ceaa7c51]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ef88c0-ae91-4b5d-9bc4-385d377c343a]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33, portal: 172.16.0.220,3260]
Nov 10 16:55:12 user nova-compute[75102]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33, portal: 172.16.0.220,3260] successful.
Nov 10 16:55:12 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:af5e61a7-1845-4047-8359-8fef6475ef33 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf18cc0a-5ecd-40e7-9ba1-7bd3e4fd4b7c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== disconnect_volume: return (321ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:55:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Deleting instance files /opt/stack/data/nova/instances/d816effe-bfce-48b9-b434-712fc862bb5f_del
Nov 10 16:55:12 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Deletion of /opt/stack/data/nova/instances/d816effe-bfce-48b9-b434-712fc862bb5f_del complete
Nov 10 16:55:12 user nova-compute[75102]: INFO nova.compute.manager [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Took 1.17 seconds to destroy the instance on the hypervisor.
Nov 10 16:55:12 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:55:12 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:55:13 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:55:13 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Took 0.42 seconds to deallocate network for instance.
Nov 10 16:55:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-a2b6a0e3-3d6f-47bb-b03f-b14b00f76625 req-33d81963-4fc1-40b1-a7db-9028d75fa529 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received event network-vif-deleted-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:55:13 user nova-compute[75102]: INFO nova.compute.manager [req-a2b6a0e3-3d6f-47bb-b03f-b14b00f76625 req-33d81963-4fc1-40b1-a7db-9028d75fa529 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Neutron deleted interface 02e11597-3b15-414d-a3d7-28d1cb89b7d7; detaching it from the instance and deleting it from the info cache
Nov 10 16:55:13 user nova-compute[75102]: DEBUG nova.network.neutron [req-a2b6a0e3-3d6f-47bb-b03f-b14b00f76625 req-33d81963-4fc1-40b1-a7db-9028d75fa529 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:55:13 user nova-compute[75102]: DEBUG nova.compute.manager [req-a2b6a0e3-3d6f-47bb-b03f-b14b00f76625 req-33d81963-4fc1-40b1-a7db-9028d75fa529 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Detach interface failed, port_id=02e11597-3b15-414d-a3d7-28d1cb89b7d7, reason: Instance d816effe-bfce-48b9-b434-712fc862bb5f could not be found. {{(pid=75102) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 10 16:55:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-de9ea13a-5145-43ef-946a-50efea19bfa5 req-9afae3ac-efa3-4dc6-b7b6-e7d7ec23fab5 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received event network-vif-plugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:55:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-de9ea13a-5145-43ef-946a-50efea19bfa5 req-9afae3ac-efa3-4dc6-b7b6-e7d7ec23fab5 service nova] Acquiring lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:55:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-de9ea13a-5145-43ef-946a-50efea19bfa5 req-9afae3ac-efa3-4dc6-b7b6-e7d7ec23fab5 service nova] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:55:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-de9ea13a-5145-43ef-946a-50efea19bfa5 req-9afae3ac-efa3-4dc6-b7b6-e7d7ec23fab5 service nova] Lock "d816effe-bfce-48b9-b434-712fc862bb5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:55:14 user nova-compute[75102]: DEBUG nova.compute.manager [req-de9ea13a-5145-43ef-946a-50efea19bfa5 req-9afae3ac-efa3-4dc6-b7b6-e7d7ec23fab5 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] No waiting events found dispatching network-vif-plugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:55:14 user nova-compute[75102]: WARNING nova.compute.manager [req-de9ea13a-5145-43ef-946a-50efea19bfa5 req-9afae3ac-efa3-4dc6-b7b6-e7d7ec23fab5 service nova] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Received unexpected event network-vif-plugged-02e11597-3b15-414d-a3d7-28d1cb89b7d7 for instance with vm_state active and task_state deleting.
Nov 10 16:55:14 user nova-compute[75102]: INFO nova.compute.manager [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: d816effe-bfce-48b9-b434-712fc862bb5f] Took 0.92 seconds to detach 1 volumes for instance.
Nov 10 16:55:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:55:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:55:14 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:55:14 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:55:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:55:14 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Deleted allocations for instance d816effe-bfce-48b9-b434-712fc862bb5f
Nov 10 16:55:14 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-927b2d77-f1e9-46aa-9699-06cc2df5ea07 tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "d816effe-bfce-48b9-b434-712fc862bb5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.951s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:55:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:55:19 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:21 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:22 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:55:23 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:55:23 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8162MB free_disk=24.978008270263672GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1eed0b35-1df9-442f-a467-68afaec4db3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9fc7541-3321-4340-830f-c73af84d428b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:55:23 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.352s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:55:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:27 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:55:27 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:55:27 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:55:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:55:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:55:27 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:55:27 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:55:28 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating instance_info_cache with network_info: [{"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:55:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:55:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:55:28 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:55:28 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:55:28 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:55:28 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:55:28 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:55:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwlhjJCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:55:33 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:55:33 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:55:33 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dbc91a-0631-41d6-9641-45008eb677e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:55:33 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[81682012-1dc1-4a0b-a05e-cc7f1eca2e00]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679] added
Nov 10 16:55:33 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca59eaea-a528-4b23-8dde-29d7518c0007]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1dde73e-eb26-447b-890d-8ed5385db223]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AwlhjJCa {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v AwlhjJCa" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9259bda-661e-479d-869c-cdab885d855c]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'AwlhjJCa'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74e4e83-5e32-46ab-b7fd-b8f13c81d439]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e87bf3-a424-48da-9a9a-771133595700]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:55:33 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:55:33 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:55:33 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:55:33 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f35c5aa9-27d9-4807-aa5d-e27bb94b8779]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679, portal: 172.16.0.220,3260]
Nov 10 16:55:33 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679, portal: 172.16.0.220,3260] successful.
Nov 10 16:55:33 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[91527e08-bb0a-4268-b77d-b1d2bd322cb4]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[65909b7d-ace5-48e0-a022-c43b4e9cb139]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:55:33 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:55:33 user nova-compute[75102]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 (non-flash)
Nov 10 16:55:33 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:55:33 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:55:33 user nova-compute[75102]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 (non-flash)
Nov 10 16:55:33 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a4d8d3-f2cf-4883-8c87-1c20dedb3e2e]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:55:33 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwlhjJCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:55:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:55:34 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23865666233373863', 'path': '/dev/sdd'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:55:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23865666233373863', 'path': '/dev/sdd'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:55:34 user nova-compute[75102]: DEBUG nova.objects.instance [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lazy-loading 'flavor' on Instance uuid 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:55:34 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:55:34 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:55:34 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:55:34 user nova-compute[75102]:   <target dev="vdc" bus="virtio"/>
Nov 10 16:55:34 user nova-compute[75102]:   <serial>922564e6-6e0f-47e9-a1b0-f5e652d6b679</serial>
Nov 10 16:55:34 user nova-compute[75102]: </disk>
Nov 10 16:55:34 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:55:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:55:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:55:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:55:35 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] No VIF found with MAC fa:16:3e:2f:53:1d, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:55:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-3ac9764d-f650-4f50-8714-b8b499a29420 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 58.011s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:55:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:55:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:55:36 user nova-compute[75102]: INFO nova.compute.manager [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Detaching volume 922564e6-6e0f-47e9-a1b0-f5e652d6b679
Nov 10 16:55:36 user nova-compute[75102]: INFO nova.virt.block_device [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Attempting to driver detach volume 922564e6-6e0f-47e9-a1b0-f5e652d6b679 from mountpoint /dev/vdc
Nov 10 16:55:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Attempting to detach device vdc from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:55:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:55:36 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:55:36 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:55:36 user nova-compute[75102]:   <target dev="vdc" bus="virtio"/>
Nov 10 16:55:36 user nova-compute[75102]:   <serial>922564e6-6e0f-47e9-a1b0-f5e652d6b679</serial>
Nov 10 16:55:36 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 16:55:36 user nova-compute[75102]: </disk>
Nov 10 16:55:36 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:55:36 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Successfully detached device vdc from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 from the persistent domain config.
Nov 10 16:55:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:55:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:55:36 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:55:36 user nova-compute[75102]:   <source dev="/dev/sdd"/>
Nov 10 16:55:36 user nova-compute[75102]:   <target dev="vdc" bus="virtio"/>
Nov 10 16:55:36 user nova-compute[75102]:   <serial>922564e6-6e0f-47e9-a1b0-f5e652d6b679</serial>
Nov 10 16:55:36 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 10 16:55:36 user nova-compute[75102]: </disk>
Nov 10 16:55:36 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:55:36 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:55:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:55:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:55:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:55:56 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 is timed out.
Nov 10 16:55:57 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Successfully detached device vdc from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 from the live domain config.
Nov 10 16:55:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'AwlhjJCa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:55:57 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c98d4a7-22b1-4d69-bed2-9cbb6f1ebecd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:55:57 user nova-compute[75102]: No targets found.
Nov 10 16:55:57 user nova-compute[75102]: iSNS:
Nov 10 16:55:57 user nova-compute[75102]: No targets found.
Nov 10 16:55:57 user nova-compute[75102]: STATIC:
Nov 10 16:55:57 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f
Nov 10 16:55:57 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:55:57 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:55:57 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679
Nov 10 16:55:57 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:55:57 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:55:57 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0
Nov 10 16:55:57 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:55:57 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:55:57 user nova-compute[75102]: FIRMWARE:
Nov 10 16:55:57 user nova-compute[75102]: No targets found.
Nov 10 16:55:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:55:57 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:55:57 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f7043c2-34ee-4cae-a06f-96d653e7f6ed]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[713f802f-b6b4-42a0-9dc9-f16f96f2509c]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:55:57 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:55:57 user nova-compute[75102]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 (non-flash)
Nov 10 16:55:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:55:57 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:55:57 user nova-compute[75102]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 (non-flash)
Nov 10 16:55:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f7459ff40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679'): ({'sdd'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Removing single pathed devices sdd {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0c38574-451b-4b5c-a9b4-591391c0992a]: (4, ('path checker states:\nup                  2\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[db15b2f9-2050-4160-9362-16a34ae2eb90]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Flushing IO for device /dev/sdd {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c01eb6-2a8b-4f46-bdf2-14b4f5bc96d5]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[320e0317-7cd0-4afb-914d-05cc31df5881]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] SCSI volumes sdd have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cdcfe9-f20b-4fb1-b683-cbe8f1c0780d]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9397d3e5-a3e0-4b6c-90f9-7128d2d40684]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679, portal: 172.16.0.220,3260]
Nov 10 16:55:57 user nova-compute[75102]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679, portal: 172.16.0.220,3260] successful.
Nov 10 16:55:57 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:922564e6-6e0f-47e9-a1b0-f5e652d6b679 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6a5099-ad67-4226-abec-a746a8f80a3e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.291s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] <== disconnect_volume: return (292ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:55:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:55:58 user nova-compute[75102]: DEBUG nova.objects.instance [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lazy-loading 'flavor' on Instance uuid 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:55:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9a4f13fb-6091-48c2-a47d-162f3ff4543b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.056s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:56:21 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:21 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:21 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:22 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:23 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:24 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:56:25 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:56:25 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8323MB free_disk=24.976253509521484GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 1eed0b35-1df9-442f-a467-68afaec4db3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9fc7541-3321-4340-830f-c73af84d428b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=3584MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.375s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "1eed0b35-1df9-442f-a467-68afaec4db3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:26 user nova-compute[75102]: INFO nova.compute.manager [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Terminating instance
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.compute.manager [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-f6c9e7fb-13bd-4083-af8b-367e029a6ddf req-37a9345d-e37b-40f4-a018-f415243db596 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received event network-changed-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.compute.manager [req-f6c9e7fb-13bd-4083-af8b-367e029a6ddf req-37a9345d-e37b-40f4-a018-f415243db596 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Refreshing instance network info cache due to event network-changed-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f6c9e7fb-13bd-4083-af8b-367e029a6ddf req-37a9345d-e37b-40f4-a018-f415243db596 service nova] Acquiring lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f6c9e7fb-13bd-4083-af8b-367e029a6ddf req-37a9345d-e37b-40f4-a018-f415243db596 service nova] Acquired lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.network.neutron [req-f6c9e7fb-13bd-4083-af8b-367e029a6ddf req-37a9345d-e37b-40f4-a018-f415243db596 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Refreshing network info cache for port b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.network.neutron [req-f6c9e7fb-13bd-4083-af8b-367e029a6ddf req-37a9345d-e37b-40f4-a018-f415243db596 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updated VIF entry in instance network info cache for port b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.network.neutron [req-f6c9e7fb-13bd-4083-af8b-367e029a6ddf req-37a9345d-e37b-40f4-a018-f415243db596 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updating instance_info_cache with network_info: [{"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:56:26 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Instance destroyed successfully.
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.objects.instance [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lazy-loading 'resources' on Instance uuid 1eed0b35-1df9-442f-a467-68afaec4db3a {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-f6c9e7fb-13bd-4083-af8b-367e029a6ddf req-37a9345d-e37b-40f4-a018-f415243db596 service nova] Releasing lock "refresh_cache-1eed0b35-1df9-442f-a467-68afaec4db3a" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:50:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-2098181851',display_name='tempest-TestVolumeBootPattern-server-2098181851',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-2098181851',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPc6FiKI8yHPuMKOdaO26PxW/aCJ98TUCcCllqqiqK2tNkUCO/KNPylVTg9aOD8uUhOmWSGRMK4FoJRAe1c23FiUDj6oHLaituQ2fadfYZyJkGulZUkOdUBgbcUsOPIriQ==',key_name='tempest-TestVolumeBootPattern-796132362',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:50:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fe3cd7409a94429d9262ef8a2a664d7c',ramdisk_id='',reservation_id='r-sv7smc9t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1535704831',owner_user_name='tempest-TestVolumeBootPattern-1535704831-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:50:45Z,user_data=None,user_id='e96544e5daa74d51a232f565129b328a',uuid=1eed0b35-1df9-442f-a467-68afaec4db3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converting VIF {"id": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "address": "fa:16:3e:9e:39:ce", "network": {"id": "31ef1840-fe67-4395-9f0f-3a81c6aed9f6", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1553822861-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fe3cd7409a94429d9262ef8a2a664d7c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb9f1cc8f-4e", "ovs_interfaceid": "b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9e:39:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f1cc8f-4e') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG os_vif [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:39:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f1cc8f-4e') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb9f1cc8f-4e, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92286179-954a-4a92-afc2-c39a6add50ad) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:56:26 user nova-compute[75102]: INFO os_vif [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9e:39:ce,bridge_name='br-int',has_traffic_filtering=True,id=b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83,network=Network(31ef1840-fe67-4395-9f0f-3a81c6aed9f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb9f1cc8f-4e')
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qSyIAzbi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:56:27 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[da9a36b4-95fc-47d8-99bd-64d667ed1ca4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:56:27 user nova-compute[75102]: No targets found.
Nov 10 16:56:27 user nova-compute[75102]: iSNS:
Nov 10 16:56:27 user nova-compute[75102]: No targets found.
Nov 10 16:56:27 user nova-compute[75102]: STATIC:
Nov 10 16:56:27 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f
Nov 10 16:56:27 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:56:27 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:56:27 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0
Nov 10 16:56:27 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:56:27 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:56:27 user nova-compute[75102]: FIRMWARE:
Nov 10 16:56:27 user nova-compute[75102]: No targets found.
Nov 10 16:56:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:56:27 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:56:27 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05b6a2f-df36-49fc-9ff1-0015b9603065]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e57283-2837-49b3-b358-50e96c8be056]: (4, ('tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:56:27 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:56:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsi session list stdout=tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f (non-flash)
Nov 10 16:56:27 user nova-compute[75102]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:56:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f746057e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f'): ({'sdc'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Removing single pathed devices sdc {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:27 user nova-compute[75102]: INFO nova.compute.manager [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Detaching volume 58b5c829-d2d5-4e7c-9e19-e188e598bce0
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cf05e0-c567-4e39-9987-ef1017b7c42d]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa21af66-4f23-448c-a125-b48767454b8b]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Flushing IO for device /dev/sdc {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[903ea516-d5bc-404a-ae7d-cb325405bcea]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: INFO nova.virt.block_device [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Attempting to driver detach volume 58b5c829-d2d5-4e7c-9e19-e188e598bce0 from mountpoint /dev/vdb
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8204c5f5-5538-490f-acd5-21ce2b7174d0]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] SCSI volumes sdc have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Attempting to detach device vdb from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:56:27 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:56:27 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:56:27 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:56:27 user nova-compute[75102]:   <serial>58b5c829-d2d5-4e7c-9e19-e188e598bce0</serial>
Nov 10 16:56:27 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:56:27 user nova-compute[75102]: </disk>
Nov 10 16:56:27 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Successfully detached device vdb from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 from the persistent domain config.
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 16:56:27 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:56:27 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:56:27 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:56:27 user nova-compute[75102]:   <serial>58b5c829-d2d5-4e7c-9e19-e188e598bce0</serial>
Nov 10 16:56:27 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 16:56:27 user nova-compute[75102]: </disk>
Nov 10 16:56:27 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e260d355-87d2-47f1-bb03-f78dced7751e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --logout" returned: 0 in 0.074s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f5ce33-7458-4fd6-9544-1e99a6c7bf6b]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260]
Nov 10 16:56:27 user nova-compute[75102]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f, portal: 172.16.0.220,3260] successful.
Nov 10 16:56:27 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c1a98f4f-dd8d-497e-b8b7-2c04d13e527f -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[5079642f-f956-4ac6-9432-05980aa91784]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] <== disconnect_volume: return (362ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:56:27 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Deleting instance files /opt/stack/data/nova/instances/1eed0b35-1df9-442f-a467-68afaec4db3a_del
Nov 10 16:56:27 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Deletion of /opt/stack/data/nova/instances/1eed0b35-1df9-442f-a467-68afaec4db3a_del complete
Nov 10 16:56:27 user nova-compute[75102]: INFO nova.compute.manager [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Took 1.30 seconds to destroy the instance on the hypervisor.
Nov 10 16:56:27 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:56:27 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Took 0.38 seconds to deallocate network for instance.
Nov 10 16:56:27 user nova-compute[75102]: DEBUG nova.compute.manager [req-bba8b62e-c137-49f7-ac19-1bcccba1436f req-51311282-0fb7-4116-8de0-abfb24c78621 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received event network-vif-deleted-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received event network-vif-unplugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] Acquiring lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] No waiting events found dispatching network-vif-unplugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received event network-vif-unplugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received event network-vif-plugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] Acquiring lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG nova.compute.manager [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] No waiting events found dispatching network-vif-plugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:56:28 user nova-compute[75102]: WARNING nova.compute.manager [req-d209e541-bd23-40ff-8df4-5668a423c6d8 req-5f1430da-69c3-455c-8a93-6bf239d52828 service nova] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Received unexpected event network-vif-plugged-b9f1cc8f-4e72-487d-b4fa-1bb5e833cf83 for instance with vm_state active and task_state deleting.
Nov 10 16:56:28 user nova-compute[75102]: INFO nova.compute.manager [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] [instance: 1eed0b35-1df9-442f-a467-68afaec4db3a] Took 0.92 seconds to detach 1 volumes for instance.
Nov 10 16:56:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:29 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:56:29 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:56:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.268s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:29 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Deleted allocations for instance 1eed0b35-1df9-442f-a467-68afaec4db3a
Nov 10 16:56:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-a0f8bbd4-f05b-4edc-bcd8-8053bb98c5ed tempest-TestVolumeBootPattern-1535704831 tempest-TestVolumeBootPattern-1535704831-project-member] Lock "1eed0b35-1df9-442f-a467-68afaec4db3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.050s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:56:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:56:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:56:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:56:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:56:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:56:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:56:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:56:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:56:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-3b6969f9-ba5e-4c5e-a596-224e34366cdb req-e748e8fb-f763-49e7-9e32-d323e6d057aa service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-changed-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG nova.compute.manager [req-3b6969f9-ba5e-4c5e-a596-224e34366cdb req-e748e8fb-f763-49e7-9e32-d323e6d057aa service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Refreshing instance network info cache due to event network-changed-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3b6969f9-ba5e-4c5e-a596-224e34366cdb req-e748e8fb-f763-49e7-9e32-d323e6d057aa service nova] Acquiring lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3b6969f9-ba5e-4c5e-a596-224e34366cdb req-e748e8fb-f763-49e7-9e32-d323e6d057aa service nova] Acquired lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-3b6969f9-ba5e-4c5e-a596-224e34366cdb req-e748e8fb-f763-49e7-9e32-d323e6d057aa service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Refreshing network info cache for port 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG nova.objects.instance [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'flavor' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:56:39 user nova-compute[75102]: INFO nova.compute.manager [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Attaching volume 521edc72-0ac3-44a5-8699-15e8116e25b0 to /dev/vdb
Nov 10 16:56:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-3b6969f9-ba5e-4c5e-a596-224e34366cdb req-e748e8fb-f763-49e7-9e32-d323e6d057aa service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updated VIF entry in instance network info cache for port 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG nova.network.neutron [req-3b6969f9-ba5e-4c5e-a596-224e34366cdb req-e748e8fb-f763-49e7-9e32-d323e6d057aa service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3b6969f9-ba5e-4c5e-a596-224e34366cdb req-e748e8fb-f763-49e7-9e32-d323e6d057aa service nova] Releasing lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG os_brick.utils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[099ef5d2-c35d-4e12-9de3-93d416d302ec]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:26169fc485de\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[60e6fc3e-9ef9-4309-8b10-4a2475311e64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea95f89-faa6-4596-8b57-029f9a90954e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[6343443b-05cd-4e20-8666-dc46862c2cd7]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): nvme version {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] nvme not present on system {{(pid=75102) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 10 16:56:39 user nova-compute[75102]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 10 16:56:39 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc25cf2f-561c-4710-addd-ae80d7fbbfc0]: (4, '') {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75102) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 10 16:56:39 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.lightos [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] LIGHTOS: no hostnqn found. {{(pid=75102) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 10 16:56:40 user nova-compute[75102]: DEBUG os_brick.utils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:26169fc485de', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:56:40 user nova-compute[75102]: DEBUG nova.virt.block_device [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating existing volume attachment record: 5dba40ce-69d3-44c8-863b-ad7b932d55eb {{(pid=75102) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 10 16:56:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:47 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 is timed out.
Nov 10 16:56:47 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Successfully detached device vdb from instance 9c68c3b1-4586-49f4-9042-c4ef622b1638 from the live domain config.
Nov 10 16:56:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bTJHdpEw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:56:47 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb84b11-2fbe-4126-bf43-32f869a8a2e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 16:56:47 user nova-compute[75102]: No targets found.
Nov 10 16:56:47 user nova-compute[75102]: iSNS:
Nov 10 16:56:47 user nova-compute[75102]: No targets found.
Nov 10 16:56:47 user nova-compute[75102]: STATIC:
Nov 10 16:56:47 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0
Nov 10 16:56:47 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 16:56:47 user nova-compute[75102]:                 Iface Name: default
Nov 10 16:56:47 user nova-compute[75102]: FIRMWARE:
Nov 10 16:56:47 user nova-compute[75102]: No targets found.
Nov 10 16:56:47 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 16:56:47 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 16:56:47 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed145f86-08bf-47cc-a27c-885320223a69]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[65f0f5d6-72c6-4495-87f6-133a2fb8a729]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:56:47 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 (non-flash)
Nov 10 16:56:47 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f545b0160>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d765cc-02e1-4870-b9e4-4506b03b20b3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38379d6-339b-4cae-9d94-53051ba62fde]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b09024-b484-43e4-9110-7aa871493ed7]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.031s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[8636ef59-9c75-47e8-a70c-7cfe85b1f690]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7dd3f2a-fb36-4880-bb76-d5e582b05bf4]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff868c9-6f9d-44e0-8bbf-b8ce17ee6f0c]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0, portal: 172.16.0.220,3260]
Nov 10 16:56:47 user nova-compute[75102]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0, portal: 172.16.0.220,3260] successful.
Nov 10 16:56:47 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:58b5c829-d2d5-4e7c-9e19-e188e598bce0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a868ca8f-d7f2-4c57-a068-6ea7a789e86e]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.275s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] <== disconnect_volume: return (276ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:56:47 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 16:56:48 user nova-compute[75102]: DEBUG nova.objects.instance [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lazy-loading 'flavor' on Instance uuid 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:56:48 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-0e7fdd3c-1398-4616-aad0-2d887710a42b tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.870s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:56:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:56:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Calling os-brick to attach iSCSI Volume {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfAzEjtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 16:57:02 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:57:02 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 16:57:02 user nova-compute[75102]: INFO os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c0704c-152f-47b3-927a-d85b2db56cdc]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 10 16:57:02 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f3b61d-bfae-4410-aa2d-b71428286b1e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0] added\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0] added
Nov 10 16:57:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[40405364-dd52-4ea6-84df-b6259899e772]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a84f604-fc6e-40bf-a07e-6429890fb12a]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfAzEjtr {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FfAzEjtr" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7992fc26-bec5-4115-941b-73c277094bd3]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FfAzEjtr'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cad2311d-0850-4d2a-9afe-986849a1886b]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa484cd1-9870-4b0a-abbf-9f930860ceae]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:57:02 user nova-compute[75102]:  {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 10 16:57:02 user nova-compute[75102]:  {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:57:02 user nova-compute[75102]: WARNING os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 10 16:57:02 user nova-compute[75102]: 
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --login {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02b46f7-d782-48db-8c6f-1373fb242693]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0, portal: 172.16.0.220,3260]
Nov 10 16:57:02 user nova-compute[75102]: Login to [iface: default, target: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0, portal: 172.16.0.220,3260] successful.
Nov 10 16:57:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce647a50-f443-4415-8d93-748da7aef157]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe2f959-78e6-4cb4-bf2a-e92c39914cdf]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 (non-flash)
Nov 10 16:57:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 (non-flash)
Nov 10 16:57:02 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Connected to 172.16.0.220:3260 {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75102) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75102) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 10 16:57:02 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:03 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:03 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[a573e216-52e1-44f1-bbf0-6c98a1f8b018]: (4, ('- - 0', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 16:57:03 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75102) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 10 16:57:03 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfAzEjtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75102) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 10 16:57:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 16:57:04 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '26232363863393662', 'path': '/dev/sdb'} {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 16:57:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232363863393662', 'path': '/dev/sdb'} {{(pid=75102) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 10 16:57:04 user nova-compute[75102]: DEBUG nova.objects.instance [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'flavor' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:57:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] attach device xml: <disk type="block" device="disk">
Nov 10 16:57:04 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 16:57:04 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 16:57:04 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 16:57:04 user nova-compute[75102]:   <serial>521edc72-0ac3-44a5-8699-15e8116e25b0</serial>
Nov 10 16:57:04 user nova-compute[75102]: </disk>
Nov 10 16:57:04 user nova-compute[75102]:  {{(pid=75102) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 10 16:57:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:57:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:57:04 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No VIF found with MAC fa:16:3e:d1:9d:1b, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:57:04 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-41caad54-c338-40f5-9b08-8feffbcda732 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 24.864s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:05 user nova-compute[75102]: INFO nova.compute.manager [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Rescuing
Nov 10 16:57:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:57:05 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquired lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:57:05 user nova-compute[75102]: DEBUG nova.network.neutron [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG nova.network.neutron [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Releasing lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-d6944fe5-a386-4b65-a38d-217513d62a07 req-231ddf91-8bbd-4388-bd3f-0a005c290186 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-unplugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d6944fe5-a386-4b65-a38d-217513d62a07 req-231ddf91-8bbd-4388-bd3f-0a005c290186 service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d6944fe5-a386-4b65-a38d-217513d62a07 req-231ddf91-8bbd-4388-bd3f-0a005c290186 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-d6944fe5-a386-4b65-a38d-217513d62a07 req-231ddf91-8bbd-4388-bd3f-0a005c290186 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG nova.compute.manager [req-d6944fe5-a386-4b65-a38d-217513d62a07 req-231ddf91-8bbd-4388-bd3f-0a005c290186 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-unplugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:57:06 user nova-compute[75102]: WARNING nova.compute.manager [req-d6944fe5-a386-4b65-a38d-217513d62a07 req-231ddf91-8bbd-4388-bd3f-0a005c290186 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-unplugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state active and task_state rescuing.
Nov 10 16:57:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Instance destroyed successfully.
Nov 10 16:57:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Attempting rescue
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75102) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Instance directory exists: not creating {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 10 16:57:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Creating image(s)
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'trusted_certs' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "73bfe493de089368a125d59b54d99144b83d7dfb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb --force-share --output=json" returned: 0 in 0.217s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/73bfe493de089368a125d59b54d99144b83d7dfb,backing_fmt=raw /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue" returned: 0 in 0.063s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "73bfe493de089368a125d59b54d99144b83d7dfb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.289s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'migration_context' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<c9fc7541-3321-4340-830f-c73af84d428b> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Created local disks {{(pid=75102) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Start _get_guest_xml network_info=[{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "vif_mac": "fa:16:3e:d1:9d:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'a26f5e2e-1666-4272-b064-065539894418', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'resources' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<c9fc7541-3321-4340-830f-c73af84d428b> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'numa_topology' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<c9fc7541-3321-4340-830f-c73af84d428b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:57:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:57:07 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller missing on host. {{(pid=75102) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.host [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU controller found on host. {{(pid=75102) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75102) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-10T16:11:58Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-10T16:12:10Z,direct_url=<?>,disk_format='qcow2',id=a26f5e2e-1666-4272-b064-065539894418,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='27ab322133744b01aba75af5d356371f',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-10T16:12:11Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image limits 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flavor pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Image pref 0:0:0 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75102) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Got 1 possible topologies {{(pid=75102) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.hardware [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75102) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'vcpu_model' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<c9fc7541-3321-4340-830f-c73af84d428b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1770642413',display_name='tempest-ServerRescueNegativeTestJSON-server-1770642413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1770642413',id=52,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMXtOBIgEpFHGQuo9Gj11BIKfbDZECAdmouNryZL79YX1sTu6Dy+EnPTXL60WtAyNV0nrLJnO119tFrIdluOcy+8GhV+u6aEnuulBFfk0z+3DNKmD5fUJla9GkPR7Zc2g==',key_name='tempest-keypair-1195217145',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:54:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-u3ko2vcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-10T16:54:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=c9fc7541-3321-4340-830f-c73af84d428b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "vif_mac": "fa:16:3e:d1:9d:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75102) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "vif_mac": "fa:16:3e:d1:9d:1b"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e0148c0-ca8c-442f-9b7f-e7b063fefb7e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0148c0-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'pci_devices' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.objects.base [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Object Instance<c9fc7541-3321-4340-830f-c73af84d428b> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75102) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] End _get_guest_xml xml=<domain type="kvm">
Nov 10 16:57:07 user nova-compute[75102]:   <uuid>c9fc7541-3321-4340-830f-c73af84d428b</uuid>
Nov 10 16:57:07 user nova-compute[75102]:   <name>instance-00000034</name>
Nov 10 16:57:07 user nova-compute[75102]:   <memory>524288</memory>
Nov 10 16:57:07 user nova-compute[75102]:   <vcpu>1</vcpu>
Nov 10 16:57:07 user nova-compute[75102]:   <metadata>
Nov 10 16:57:07 user nova-compute[75102]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 10 16:57:07 user nova-compute[75102]:       <nova:package version="0.0.0"/>
Nov 10 16:57:07 user nova-compute[75102]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1770642413</nova:name>
Nov 10 16:57:07 user nova-compute[75102]:       <nova:creationTime>2023-11-10 16:57:07</nova:creationTime>
Nov 10 16:57:07 user nova-compute[75102]:       <nova:flavor name="m1.tiny">
Nov 10 16:57:07 user nova-compute[75102]:         <nova:memory>512</nova:memory>
Nov 10 16:57:07 user nova-compute[75102]:         <nova:disk>1</nova:disk>
Nov 10 16:57:07 user nova-compute[75102]:         <nova:swap>0</nova:swap>
Nov 10 16:57:07 user nova-compute[75102]:         <nova:ephemeral>0</nova:ephemeral>
Nov 10 16:57:07 user nova-compute[75102]:         <nova:vcpus>1</nova:vcpus>
Nov 10 16:57:07 user nova-compute[75102]:       </nova:flavor>
Nov 10 16:57:07 user nova-compute[75102]:       <nova:owner>
Nov 10 16:57:07 user nova-compute[75102]:         <nova:user uuid="cd7ddbca327e4e2893563e02cd3d3754">tempest-ServerRescueNegativeTestJSON-662150154-project-member</nova:user>
Nov 10 16:57:07 user nova-compute[75102]:         <nova:project uuid="ea704446109948239b67b37c01c2c146">tempest-ServerRescueNegativeTestJSON-662150154</nova:project>
Nov 10 16:57:07 user nova-compute[75102]:       </nova:owner>
Nov 10 16:57:07 user nova-compute[75102]:       <nova:root type="image" uuid="a26f5e2e-1666-4272-b064-065539894418"/>
Nov 10 16:57:07 user nova-compute[75102]:       <nova:ports>
Nov 10 16:57:07 user nova-compute[75102]:         <nova:port uuid="3e0148c0-ca8c-442f-9b7f-e7b063fefb7e">
Nov 10 16:57:07 user nova-compute[75102]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 10 16:57:07 user nova-compute[75102]:         </nova:port>
Nov 10 16:57:07 user nova-compute[75102]:       </nova:ports>
Nov 10 16:57:07 user nova-compute[75102]:     </nova:instance>
Nov 10 16:57:07 user nova-compute[75102]:   </metadata>
Nov 10 16:57:07 user nova-compute[75102]:   <sysinfo type="smbios">
Nov 10 16:57:07 user nova-compute[75102]:     <system>
Nov 10 16:57:07 user nova-compute[75102]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 10 16:57:07 user nova-compute[75102]:       <entry name="product">OpenStack Nova</entry>
Nov 10 16:57:07 user nova-compute[75102]:       <entry name="version">0.0.0</entry>
Nov 10 16:57:07 user nova-compute[75102]:       <entry name="serial">c9fc7541-3321-4340-830f-c73af84d428b</entry>
Nov 10 16:57:07 user nova-compute[75102]:       <entry name="uuid">c9fc7541-3321-4340-830f-c73af84d428b</entry>
Nov 10 16:57:07 user nova-compute[75102]:       <entry name="family">Virtual Machine</entry>
Nov 10 16:57:07 user nova-compute[75102]:     </system>
Nov 10 16:57:07 user nova-compute[75102]:   </sysinfo>
Nov 10 16:57:07 user nova-compute[75102]:   <os>
Nov 10 16:57:07 user nova-compute[75102]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 10 16:57:07 user nova-compute[75102]:     <smbios mode="sysinfo"/>
Nov 10 16:57:07 user nova-compute[75102]:   </os>
Nov 10 16:57:07 user nova-compute[75102]:   <features>
Nov 10 16:57:07 user nova-compute[75102]:     <acpi/>
Nov 10 16:57:07 user nova-compute[75102]:     <apic/>
Nov 10 16:57:07 user nova-compute[75102]:     <vmcoreinfo/>
Nov 10 16:57:07 user nova-compute[75102]:   </features>
Nov 10 16:57:07 user nova-compute[75102]:   <clock offset="utc">
Nov 10 16:57:07 user nova-compute[75102]:     <timer name="pit" tickpolicy="delay"/>
Nov 10 16:57:07 user nova-compute[75102]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 10 16:57:07 user nova-compute[75102]:     <timer name="hpet" present="no"/>
Nov 10 16:57:07 user nova-compute[75102]:   </clock>
Nov 10 16:57:07 user nova-compute[75102]:   <cpu mode="custom" match="exact">
Nov 10 16:57:07 user nova-compute[75102]:     <model>Nehalem</model>
Nov 10 16:57:07 user nova-compute[75102]:     <topology sockets="1" cores="1" threads="1"/>
Nov 10 16:57:07 user nova-compute[75102]:   </cpu>
Nov 10 16:57:07 user nova-compute[75102]:   <devices>
Nov 10 16:57:07 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:57:07 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:57:07 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue"/>
Nov 10 16:57:07 user nova-compute[75102]:       <target dev="vda" bus="virtio"/>
Nov 10 16:57:07 user nova-compute[75102]:     </disk>
Nov 10 16:57:07 user nova-compute[75102]:     <disk type="file" device="disk">
Nov 10 16:57:07 user nova-compute[75102]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 10 16:57:07 user nova-compute[75102]:       <source file="/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk"/>
Nov 10 16:57:07 user nova-compute[75102]:       <target dev="vdb" bus="virtio"/>
Nov 10 16:57:07 user nova-compute[75102]:     </disk>
Nov 10 16:57:07 user nova-compute[75102]:     <interface type="ethernet">
Nov 10 16:57:07 user nova-compute[75102]:       <mac address="fa:16:3e:d1:9d:1b"/>
Nov 10 16:57:07 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:57:07 user nova-compute[75102]:       <mtu size="1442"/>
Nov 10 16:57:07 user nova-compute[75102]:       <target dev="tap3e0148c0-ca"/>
Nov 10 16:57:07 user nova-compute[75102]:     </interface>
Nov 10 16:57:07 user nova-compute[75102]:     <serial type="pty">
Nov 10 16:57:07 user nova-compute[75102]:       <log file="/opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/console.log" append="off"/>
Nov 10 16:57:07 user nova-compute[75102]:     </serial>
Nov 10 16:57:07 user nova-compute[75102]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 10 16:57:07 user nova-compute[75102]:     <video>
Nov 10 16:57:07 user nova-compute[75102]:       <model type="virtio"/>
Nov 10 16:57:07 user nova-compute[75102]:     </video>
Nov 10 16:57:07 user nova-compute[75102]:     <rng model="virtio">
Nov 10 16:57:07 user nova-compute[75102]:       <backend model="random">/dev/urandom</backend>
Nov 10 16:57:07 user nova-compute[75102]:     </rng>
Nov 10 16:57:07 user nova-compute[75102]:     <controller type="usb" index="0" model="none"/>
Nov 10 16:57:07 user nova-compute[75102]:     <memballoon model="virtio">
Nov 10 16:57:07 user nova-compute[75102]:       <stats period="10"/>
Nov 10 16:57:07 user nova-compute[75102]:     </memballoon>
Nov 10 16:57:07 user nova-compute[75102]:   </devices>
Nov 10 16:57:07 user nova-compute[75102]: </domain>
Nov 10 16:57:07 user nova-compute[75102]:  {{(pid=75102) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 10 16:57:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Instance destroyed successfully.
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75102) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 10 16:57:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] No VIF found with MAC fa:16:3e:d1:9d:1b, not building metadata {{(pid=75102) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 10 16:57:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-7d5a8a64-aa40-4afd-be38-08246c7eb1ee req-d651680e-06b6-402c-84c1-1060c6f6fa14 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:57:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7d5a8a64-aa40-4afd-be38-08246c7eb1ee req-d651680e-06b6-402c-84c1-1060c6f6fa14 service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7d5a8a64-aa40-4afd-be38-08246c7eb1ee req-d651680e-06b6-402c-84c1-1060c6f6fa14 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-7d5a8a64-aa40-4afd-be38-08246c7eb1ee req-d651680e-06b6-402c-84c1-1060c6f6fa14 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-7d5a8a64-aa40-4afd-be38-08246c7eb1ee req-d651680e-06b6-402c-84c1-1060c6f6fa14 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:57:08 user nova-compute[75102]: WARNING nova.compute.manager [req-7d5a8a64-aa40-4afd-be38-08246c7eb1ee req-d651680e-06b6-402c-84c1-1060c6f6fa14 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state active and task_state rescuing.
Nov 10 16:57:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:57:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:57:10 user nova-compute[75102]: WARNING nova.compute.manager [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state active and task_state rescuing.
Nov 10 16:57:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:57:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:57:10 user nova-compute[75102]: WARNING nova.compute.manager [req-e19cad36-038c-4b7a-be8c-cab26d6ca99f req-88a0b789-85b1-49ac-b3d5-5a6a1e5bdbe5 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state active and task_state rescuing.
Nov 10 16:57:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:11 user nova-compute[75102]: DEBUG nova.compute.manager [None req-29518598-eda6-4dfa-a4a9-95da5cded96f tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:57:11 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:17 user nova-compute[75102]: INFO nova.compute.manager [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Terminating instance
Nov 10 16:57:17 user nova-compute[75102]: DEBUG nova.compute.manager [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-4d800ed2-fa12-4ffc-ae05-10e7b97c65b3 req-047c7a77-437f-4c30-a0a4-abe418943749 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received event network-vif-unplugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4d800ed2-fa12-4ffc-ae05-10e7b97c65b3 req-047c7a77-437f-4c30-a0a4-abe418943749 service nova] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4d800ed2-fa12-4ffc-ae05-10e7b97c65b3 req-047c7a77-437f-4c30-a0a4-abe418943749 service nova] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4d800ed2-fa12-4ffc-ae05-10e7b97c65b3 req-047c7a77-437f-4c30-a0a4-abe418943749 service nova] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-4d800ed2-fa12-4ffc-ae05-10e7b97c65b3 req-047c7a77-437f-4c30-a0a4-abe418943749 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] No waiting events found dispatching network-vif-unplugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG nova.compute.manager [req-4d800ed2-fa12-4ffc-ae05-10e7b97c65b3 req-047c7a77-437f-4c30-a0a4-abe418943749 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received event network-vif-unplugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Instance destroyed successfully.
Nov 10 16:57:18 user nova-compute[75102]: DEBUG nova.objects.instance [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lazy-loading 'resources' on Instance uuid 9c68c3b1-4586-49f4-9042-c4ef622b1638 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:52:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1942845567',display_name='tempest-TestServerVolumeAttachmentScenario-server-1942845567',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1942845567',id=50,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA7zpCc85fGr6XMhJrd0wG7QTmgLzkMX8uspbKaIgg4c++i3YISonncBzuK1zdwoxmDno6C7ZtXcVEusnzBrWa8E/AjPSSzb2NAlJUj6HNZadHcGC1LhtGJ0ZG03vr11ag==',key_name='tempest-keypair-1266934672',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:52:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c931e79171af44b39dca71ec088fd01f',ramdisk_id='',reservation_id='r-0pl8gvc0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-852154045',owner_user_name='tempest-TestServerVolumeAttachmentScenario-852154045-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:52:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ffff704c546e40ae85fbe8e74402ff25',uuid=9c68c3b1-4586-49f4-9042-c4ef622b1638,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Converting VIF {"id": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "address": "fa:16:3e:2f:53:1d", "network": {"id": "51ac06f7-9da5-4d50-8165-f56e811e1d06", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-715306438-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.8", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c931e79171af44b39dca71ec088fd01f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapbd64bf27-43", "ovs_interfaceid": "bd64bf27-431c-4a0f-8999-53df16ea62d7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2f:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=bd64bf27-431c-4a0f-8999-53df16ea62d7,network=Network(51ac06f7-9da5-4d50-8165-f56e811e1d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd64bf27-43') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG os_vif [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=bd64bf27-431c-4a0f-8999-53df16ea62d7,network=Network(51ac06f7-9da5-4d50-8165-f56e811e1d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd64bf27-43') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapbd64bf27-43, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=562fc226-dfee-4996-ac0a-5ed622ab5dfc) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:18 user nova-compute[75102]: INFO os_vif [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2f:53:1d,bridge_name='br-int',has_traffic_filtering=True,id=bd64bf27-431c-4a0f-8999-53df16ea62d7,network=Network(51ac06f7-9da5-4d50-8165-f56e811e1d06),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapbd64bf27-43')
Nov 10 16:57:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Deleting instance files /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638_del
Nov 10 16:57:18 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Deletion of /opt/stack/data/nova/instances/9c68c3b1-4586-49f4-9042-c4ef622b1638_del complete
Nov 10 16:57:18 user nova-compute[75102]: INFO nova.compute.manager [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Took 1.05 seconds to destroy the instance on the hypervisor.
Nov 10 16:57:18 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:57:18 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:57:19 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:57:19 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Took 1.05 seconds to deallocate network for instance.
Nov 10 16:57:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:19 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:20 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:57:20 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:57:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-8273610a-ae84-46c7-b063-a84a96359c6c req-e6c2e5bd-3c63-49e2-8db5-358dae257dc6 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received event network-vif-plugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:57:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8273610a-ae84-46c7-b063-a84a96359c6c req-e6c2e5bd-3c63-49e2-8db5-358dae257dc6 service nova] Acquiring lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8273610a-ae84-46c7-b063-a84a96359c6c req-e6c2e5bd-3c63-49e2-8db5-358dae257dc6 service nova] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8273610a-ae84-46c7-b063-a84a96359c6c req-e6c2e5bd-3c63-49e2-8db5-358dae257dc6 service nova] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-8273610a-ae84-46c7-b063-a84a96359c6c req-e6c2e5bd-3c63-49e2-8db5-358dae257dc6 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] No waiting events found dispatching network-vif-plugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:57:20 user nova-compute[75102]: WARNING nova.compute.manager [req-8273610a-ae84-46c7-b063-a84a96359c6c req-e6c2e5bd-3c63-49e2-8db5-358dae257dc6 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received unexpected event network-vif-plugged-bd64bf27-431c-4a0f-8999-53df16ea62d7 for instance with vm_state deleted and task_state None.
Nov 10 16:57:20 user nova-compute[75102]: DEBUG nova.compute.manager [req-8273610a-ae84-46c7-b063-a84a96359c6c req-e6c2e5bd-3c63-49e2-8db5-358dae257dc6 service nova] [instance: 9c68c3b1-4586-49f4-9042-c4ef622b1638] Received event network-vif-deleted-bd64bf27-431c-4a0f-8999-53df16ea62d7 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:57:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.264s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:20 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Deleted allocations for instance 9c68c3b1-4586-49f4-9042-c4ef622b1638
Nov 10 16:57:20 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-185ebebe-7151-44ef-b529-ef927a1b6817 tempest-TestServerVolumeAttachmentScenario-852154045 tempest-TestServerVolumeAttachmentScenario-852154045-project-member] Lock "9c68c3b1-4586-49f4-9042-c4ef622b1638" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.560s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:21 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:22 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:24 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:24 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:57:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue --force-share --output=json" returned: 0 in 0.203s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:24 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.240s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.251s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:57:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:57:27 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:57:27 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8500MB free_disk=25.001235961914062GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9fc7541-3321-4340-830f-c73af84d428b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:57:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.666s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:57:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:57:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:57:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:57:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:57:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updating instance_info_cache with network_info: [{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:57:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:57:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:57:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:57:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:39 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:44 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:44 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 16:57:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:57:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:57:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:57:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:57:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:57:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:57:50 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:57:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 16:57:50 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 16:57:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:57:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:58:08 user nova-compute[75102]: INFO nova.compute.manager [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Terminating instance
Nov 10 16:58:08 user nova-compute[75102]: DEBUG nova.compute.manager [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-91551252-266e-4011-b6fb-11c588b4e2b5 req-2b4e247b-31c5-4d40-96a6-9820c70a2dd7 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received event network-vif-unplugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91551252-266e-4011-b6fb-11c588b4e2b5 req-2b4e247b-31c5-4d40-96a6-9820c70a2dd7 service nova] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91551252-266e-4011-b6fb-11c588b4e2b5 req-2b4e247b-31c5-4d40-96a6-9820c70a2dd7 service nova] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-91551252-266e-4011-b6fb-11c588b4e2b5 req-2b4e247b-31c5-4d40-96a6-9820c70a2dd7 service nova] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-91551252-266e-4011-b6fb-11c588b4e2b5 req-2b4e247b-31c5-4d40-96a6-9820c70a2dd7 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] No waiting events found dispatching network-vif-unplugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-91551252-266e-4011-b6fb-11c588b4e2b5 req-2b4e247b-31c5-4d40-96a6-9820c70a2dd7 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received event network-vif-unplugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Instance destroyed successfully.
Nov 10 16:58:09 user nova-compute[75102]: DEBUG nova.objects.instance [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lazy-loading 'resources' on Instance uuid 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:45:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1099820247',display_name='tempest-SnapshotDataIntegrityTests-server-1099820247',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1099820247',id=45,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIMNpu11uolMmOOlrbcOMvniHI2BuBvpridRlVJi/GBULwbUP3QhVmNvGiOAPzx46Dt6Y0JJiHrb7mbfu9svT9M9TpYaLf/FxOD/SbnfVXgz796d3PJHVD3/MSonRpf78Q==',key_name='tempest-keypair-838950257',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:45:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='dfff2444d6464eb0bf0ed2b70ecd9632',ramdisk_id='',reservation_id='r-bvrtilkk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1928124122',owner_user_name='tempest-SnapshotDataIntegrityTests-1928124122-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:45:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b1288107335b4917aec11482f38508ec',uuid=3df267ce-8bcb-41bb-bf17-b13f1cecd5f5,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Converting VIF {"id": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "address": "fa:16:3e:97:95:f1", "network": {"id": "2db41338-c774-42e4-a415-9a8a1e6a7f31", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1645297159-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.23", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "dfff2444d6464eb0bf0ed2b70ecd9632", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf5f212dd-f3", "ovs_interfaceid": "f5f212dd-f32e-4263-aa46-5176ea1a32d9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:97:95:f1,bridge_name='br-int',has_traffic_filtering=True,id=f5f212dd-f32e-4263-aa46-5176ea1a32d9,network=Network(2db41338-c774-42e4-a415-9a8a1e6a7f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f212dd-f3') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG os_vif [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:95:f1,bridge_name='br-int',has_traffic_filtering=True,id=f5f212dd-f32e-4263-aa46-5176ea1a32d9,network=Network(2db41338-c774-42e4-a415-9a8a1e6a7f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f212dd-f3') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf5f212dd-f3, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=432ece3c-ddc8-48f5-b18a-b072a29adf04) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:58:09 user nova-compute[75102]: INFO os_vif [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:97:95:f1,bridge_name='br-int',has_traffic_filtering=True,id=f5f212dd-f32e-4263-aa46-5176ea1a32d9,network=Network(2db41338-c774-42e4-a415-9a8a1e6a7f31),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf5f212dd-f3')
Nov 10 16:58:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Deleting instance files /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5_del
Nov 10 16:58:09 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Deletion of /opt/stack/data/nova/instances/3df267ce-8bcb-41bb-bf17-b13f1cecd5f5_del complete
Nov 10 16:58:09 user nova-compute[75102]: INFO nova.compute.manager [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Took 0.91 seconds to destroy the instance on the hypervisor.
Nov 10 16:58:09 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 16:58:09 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:58:09 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Took 0.68 seconds to deallocate network for instance.
Nov 10 16:58:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-5483a598-29ef-427a-8c4e-dd5c3439e375 req-ee07d3f3-6ab0-4619-a464-0f40f91956bb service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received event network-vif-deleted-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:58:10 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Deleted allocations for instance 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5
Nov 10 16:58:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-097abb92-8cbc-46b6-97fd-b447b7fb1ef8 tempest-SnapshotDataIntegrityTests-1928124122 tempest-SnapshotDataIntegrityTests-1928124122-project-member] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.971s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-07a0ef70-23d2-4b73-b95b-86c9e1df2d6b req-6e7a86ac-5539-4680-b3cd-d332588a4eb5 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received event network-vif-plugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-07a0ef70-23d2-4b73-b95b-86c9e1df2d6b req-6e7a86ac-5539-4680-b3cd-d332588a4eb5 service nova] Acquiring lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-07a0ef70-23d2-4b73-b95b-86c9e1df2d6b req-6e7a86ac-5539-4680-b3cd-d332588a4eb5 service nova] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-07a0ef70-23d2-4b73-b95b-86c9e1df2d6b req-6e7a86ac-5539-4680-b3cd-d332588a4eb5 service nova] Lock "3df267ce-8bcb-41bb-bf17-b13f1cecd5f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:58:10 user nova-compute[75102]: DEBUG nova.compute.manager [req-07a0ef70-23d2-4b73-b95b-86c9e1df2d6b req-6e7a86ac-5539-4680-b3cd-d332588a4eb5 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] No waiting events found dispatching network-vif-plugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:58:10 user nova-compute[75102]: WARNING nova.compute.manager [req-07a0ef70-23d2-4b73-b95b-86c9e1df2d6b req-6e7a86ac-5539-4680-b3cd-d332588a4eb5 service nova] [instance: 3df267ce-8bcb-41bb-bf17-b13f1cecd5f5] Received unexpected event network-vif-plugged-f5f212dd-f32e-4263-aa46-5176ea1a32d9 for instance with vm_state deleted and task_state None.
Nov 10 16:58:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:22 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:22 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue --force-share --output=json" returned: 0 in 0.201s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:58:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.210s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:58:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:58:27 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:58:27 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:58:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8676MB free_disk=25.019420623779297GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9fc7541-3321-4340-830f-c73af84d428b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:58:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:58:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:58:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:58:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:58:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:58:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:58:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:58:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:58:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:58:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:58:31 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:31 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:58:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:58:35 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:58:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:58:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:58:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:58:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:58:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:58:57 user nova-compute[75102]: INFO nova.compute.manager [None req-44c39de3-733c-4202-b6df-42cfbe51c158 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Unrescuing
Nov 10 16:58:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-44c39de3-733c-4202-b6df-42cfbe51c158 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-44c39de3-733c-4202-b6df-42cfbe51c158 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquired lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG nova.network.neutron [None req-44c39de3-733c-4202-b6df-42cfbe51c158 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Building network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG nova.network.neutron [None req-44c39de3-733c-4202-b6df-42cfbe51c158 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-44c39de3-733c-4202-b6df-42cfbe51c158 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Releasing lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG nova.objects.instance [None req-44c39de3-733c-4202-b6df-42cfbe51c158 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'flavor' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-b88e14d6-0651-4524-8097-8380bc7ddca1 req-8c6213e9-d5ee-43e9-95c7-cb42d8ee68ca service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-unplugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b88e14d6-0651-4524-8097-8380bc7ddca1 req-8c6213e9-d5ee-43e9-95c7-cb42d8ee68ca service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b88e14d6-0651-4524-8097-8380bc7ddca1 req-8c6213e9-d5ee-43e9-95c7-cb42d8ee68ca service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-b88e14d6-0651-4524-8097-8380bc7ddca1 req-8c6213e9-d5ee-43e9-95c7-cb42d8ee68ca service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:58:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-b88e14d6-0651-4524-8097-8380bc7ddca1 req-8c6213e9-d5ee-43e9-95c7-cb42d8ee68ca service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-unplugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:58:57 user nova-compute[75102]: WARNING nova.compute.manager [req-b88e14d6-0651-4524-8097-8380bc7ddca1 req-8c6213e9-d5ee-43e9-95c7-cb42d8ee68ca service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-unplugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:58:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:58 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Instance destroyed successfully.
Nov 10 16:58:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:58:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:59:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:59:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:59:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:59:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:59:00 user nova-compute[75102]: WARNING nova.compute.manager [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:59:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:59:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:59:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:59:00 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:59:00 user nova-compute[75102]: DEBUG nova.compute.manager [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:59:00 user nova-compute[75102]: WARNING nova.compute.manager [req-4ea50d5d-ead8-4af1-8589-423dd2828153 req-e4d0c23b-a19a-413b-b8d6-d184e9f2a9c4 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state rescued and task_state unrescuing.
Nov 10 16:59:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:01 user nova-compute[75102]: DEBUG nova.compute.manager [None req-44c39de3-733c-4202-b6df-42cfbe51c158 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Checking state {{(pid=75102) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 10 16:59:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-6ba5d2df-2acf-4e83-8b69-37883bd54c11 req-4dbdb84c-23fd-456a-95cb-f3602ca2eb4b service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 16:59:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6ba5d2df-2acf-4e83-8b69-37883bd54c11 req-4dbdb84c-23fd-456a-95cb-f3602ca2eb4b service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:59:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6ba5d2df-2acf-4e83-8b69-37883bd54c11 req-4dbdb84c-23fd-456a-95cb-f3602ca2eb4b service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:59:02 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-6ba5d2df-2acf-4e83-8b69-37883bd54c11 req-4dbdb84c-23fd-456a-95cb-f3602ca2eb4b service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:59:02 user nova-compute[75102]: DEBUG nova.compute.manager [req-6ba5d2df-2acf-4e83-8b69-37883bd54c11 req-4dbdb84c-23fd-456a-95cb-f3602ca2eb4b service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 16:59:02 user nova-compute[75102]: WARNING nova.compute.manager [req-6ba5d2df-2acf-4e83-8b69-37883bd54c11 req-4dbdb84c-23fd-456a-95cb-f3602ca2eb4b service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state active and task_state None.
Nov 10 16:59:02 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:16 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:21 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:59:23 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:59:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 16:59:25 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:59:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 16:59:27 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:59:27 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 16:59:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8797MB free_disk=25.01412582397461GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9fc7541-3321-4340-830f-c73af84d428b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 16:59:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.297s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 16:59:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:59:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 16:59:29 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 16:59:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 16:59:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 16:59:29 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 16:59:29 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 16:59:30 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 16:59:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 16:59:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 16:59:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:59:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:59:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:59:30 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 16:59:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:31 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 16:59:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:59:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:59:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:59:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:59:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 16:59:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 16:59:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 16:59:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:59:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 16:59:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:00:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:00:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:00:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:00:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:00:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:00:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:00:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75102) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 10 17:00:26 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:00:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:00:28 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:00:28 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:00:28 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8820MB free_disk=25.013538360595703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9fc7541-3321-4340-830f-c73af84d428b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:00:28 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.227s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:00:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:00:31 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:31 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:31 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:00:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:00:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:00:31 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:00:32 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updating instance_info_cache with network_info: [{"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:00:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-d70f5eeb-42bd-4612-8103-9e5bc8950cea" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:00:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:00:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:00:33 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:00:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:00:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:00:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:00:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:00:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:00:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:44 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-2959841e-acaf-4d1a-90aa-e8055df8c566 req-4342d506-5c3f-4690-9e0c-c1500e1dafe7 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-changed-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG nova.compute.manager [req-2959841e-acaf-4d1a-90aa-e8055df8c566 req-4342d506-5c3f-4690-9e0c-c1500e1dafe7 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Refreshing instance network info cache due to event network-changed-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2959841e-acaf-4d1a-90aa-e8055df8c566 req-4342d506-5c3f-4690-9e0c-c1500e1dafe7 service nova] Acquiring lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2959841e-acaf-4d1a-90aa-e8055df8c566 req-4342d506-5c3f-4690-9e0c-c1500e1dafe7 service nova] Acquired lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG nova.network.neutron [req-2959841e-acaf-4d1a-90aa-e8055df8c566 req-4342d506-5c3f-4690-9e0c-c1500e1dafe7 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Refreshing network info cache for port 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:00:49 user nova-compute[75102]: INFO nova.compute.manager [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Detaching volume 521edc72-0ac3-44a5-8699-15e8116e25b0
Nov 10 17:00:49 user nova-compute[75102]: DEBUG nova.network.neutron [req-2959841e-acaf-4d1a-90aa-e8055df8c566 req-4342d506-5c3f-4690-9e0c-c1500e1dafe7 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updated VIF entry in instance network info cache for port 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG nova.network.neutron [req-2959841e-acaf-4d1a-90aa-e8055df8c566 req-4342d506-5c3f-4690-9e0c-c1500e1dafe7 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-2959841e-acaf-4d1a-90aa-e8055df8c566 req-4342d506-5c3f-4690-9e0c-c1500e1dafe7 service nova] Releasing lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:00:49 user nova-compute[75102]: INFO nova.virt.block_device [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Attempting to driver detach volume 521edc72-0ac3-44a5-8699-15e8116e25b0 from mountpoint /dev/vdb
Nov 10 17:00:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Attempting to detach device vdb from instance c9fc7541-3321-4340-830f-c73af84d428b from the persistent domain config. {{(pid=75102) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:00:49 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:00:49 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 17:00:49 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:00:49 user nova-compute[75102]:   <serial>521edc72-0ac3-44a5-8699-15e8116e25b0</serial>
Nov 10 17:00:49 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 17:00:49 user nova-compute[75102]: </disk>
Nov 10 17:00:49 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:00:49 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Successfully detached device vdb from instance c9fc7541-3321-4340-830f-c73af84d428b from the persistent domain config.
Nov 10 17:00:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance c9fc7541-3321-4340-830f-c73af84d428b from the live domain config. {{(pid=75102) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 10 17:00:49 user nova-compute[75102]: DEBUG nova.virt.libvirt.guest [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] detach device xml: <disk type="block" device="disk">
Nov 10 17:00:49 user nova-compute[75102]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 10 17:00:49 user nova-compute[75102]:   <source dev="/dev/sdb"/>
Nov 10 17:00:49 user nova-compute[75102]:   <target dev="vdb" bus="virtio"/>
Nov 10 17:00:49 user nova-compute[75102]:   <serial>521edc72-0ac3-44a5-8699-15e8116e25b0</serial>
Nov 10 17:00:49 user nova-compute[75102]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 10 17:00:49 user nova-compute[75102]: </disk>
Nov 10 17:00:49 user nova-compute[75102]:  {{(pid=75102) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 10 17:00:50 user nova-compute[75102]: DEBUG nova.virt.libvirt.driver [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 10 17:00:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-5bb26c99-5957-4fd7-81bf-d3ceab2e2f57 req-b5ab7813-a489-47d3-9cdc-192724c2eabf service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-changed-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:00:51 user nova-compute[75102]: DEBUG nova.compute.manager [req-5bb26c99-5957-4fd7-81bf-d3ceab2e2f57 req-b5ab7813-a489-47d3-9cdc-192724c2eabf service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Refreshing instance network info cache due to event network-changed-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e. {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 10 17:00:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5bb26c99-5957-4fd7-81bf-d3ceab2e2f57 req-b5ab7813-a489-47d3-9cdc-192724c2eabf service nova] Acquiring lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:00:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5bb26c99-5957-4fd7-81bf-d3ceab2e2f57 req-b5ab7813-a489-47d3-9cdc-192724c2eabf service nova] Acquired lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:00:51 user nova-compute[75102]: DEBUG nova.network.neutron [req-5bb26c99-5957-4fd7-81bf-d3ceab2e2f57 req-b5ab7813-a489-47d3-9cdc-192724c2eabf service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Refreshing network info cache for port 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 10 17:00:51 user nova-compute[75102]: DEBUG nova.network.neutron [req-5bb26c99-5957-4fd7-81bf-d3ceab2e2f57 req-b5ab7813-a489-47d3-9cdc-192724c2eabf service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updated VIF entry in instance network info cache for port 3e0148c0-ca8c-442f-9b7f-e7b063fefb7e. {{(pid=75102) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 10 17:00:51 user nova-compute[75102]: DEBUG nova.network.neutron [req-5bb26c99-5957-4fd7-81bf-d3ceab2e2f57 req-b5ab7813-a489-47d3-9cdc-192724c2eabf service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:00:51 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-5bb26c99-5957-4fd7-81bf-d3ceab2e2f57 req-b5ab7813-a489-47d3-9cdc-192724c2eabf service nova] Releasing lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:00:54 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:00:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:00:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:00:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:00:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:00:59 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:04 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:09 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:10 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance c9fc7541-3321-4340-830f-c73af84d428b is timed out.
Nov 10 17:01:10 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Successfully detached device vdb from instance c9fc7541-3321-4340-830f-c73af84d428b from the live domain config.
Nov 10 17:01:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] calling os-brick to detach iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f5f841e59c0>, {'target_iqn': 'iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FfAzEjtr', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 10 17:01:10 user nova-compute[75102]: WARNING os_brick.initiator.connectors.base [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb67909-3451-43ef-9b84-64feab300913]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 10 17:01:10 user nova-compute[75102]: No targets found.
Nov 10 17:01:10 user nova-compute[75102]: iSNS:
Nov 10 17:01:10 user nova-compute[75102]: No targets found.
Nov 10 17:01:10 user nova-compute[75102]: STATIC:
Nov 10 17:01:10 user nova-compute[75102]: Target: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0
Nov 10 17:01:10 user nova-compute[75102]:         Portal: 172.16.0.220:3260,-1
Nov 10 17:01:10 user nova-compute[75102]:                 Iface Name: default
Nov 10 17:01:10 user nova-compute[75102]: FIRMWARE:
Nov 10 17:01:10 user nova-compute[75102]: No targets found.
Nov 10 17:01:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 10 17:01:10 user nova-compute[75102]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 10 17:01:10 user nova-compute[75102]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75102) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0', 0)] {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ebaa015-2940-41f0-b43c-b0fde15939b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[577c871a-bfc6-449d-8b91-15382b5aa78d]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 (non-flash)\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 (non-flash)
Nov 10 17:01:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 (non-flash)
Nov 10 17:01:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f5f8ebcb760>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0'): ({'sdb'}, set())}) {{(pid=75102) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Removing single pathed devices sdb {{(pid=75102) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6c2d59-28b3-4c8f-b44f-9511a30139b3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[36aaaf16-da24-4e86-aa9d-e2863da15d00]: (4, ('ok\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Flushing IO for device /dev/sdb {{(pid=75102) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[c85194ea-ef47-4e7f-a5a3-3b22a5f9c0bf]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75102) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a8c8b2-8f84-4b31-8fa8-d971fef6c844]: (4, ('1', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.linuxscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] SCSI volumes sdb have been removed. {{(pid=75102) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0')] {{(pid=75102) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfd952dc-f0a4-4fc7-ba95-0ca41551ab23]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --logout {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8535836-15e2-4ad1-837f-7aa462a2d2e1]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0, portal: 172.16.0.220,3260]
Nov 10 17:01:10 user nova-compute[75102]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0, portal: 172.16.0.220,3260] successful.
Nov 10 17:01:10 user nova-compute[75102]:  stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op delete {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:521edc72-0ac3-44a5-8699-15e8116e25b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=85940) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dce1153-90ad-4e86-8e52-678b72694de9]: (4, ('', '')) {{(pid=85940) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75102) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.base [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.312s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG os_brick.initiator.connectors.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] <== disconnect_volume: return (314ms) None {{(pid=75102) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 10 17:01:10 user nova-compute[75102]: DEBUG nova.virt.libvirt.volume.iscsi [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Disconnected iSCSI Volume {{(pid=75102) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 10 17:01:11 user nova-compute[75102]: DEBUG nova.objects.instance [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'flavor' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:01:11 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-56f90890-5cb6-44ed-a25e-778d88db57d5 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.819s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:01:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:01:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:01:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:01:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:01:14 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:19 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:24 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:01:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:27 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:28 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:01:29 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:01:29 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:01:29 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8836MB free_disk=25.012805938720703GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance c9fc7541-3321-4340-830f-c73af84d428b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:01:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.272s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:01:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:01:31 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:01:31 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:01:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:01:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:01:31 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:01:32 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [{"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:01:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-c9fc7541-3321-4340-830f-c73af84d428b" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:01:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:01:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:01:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:01:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:01:33 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:01:33 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:01:34 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:01:39 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:01:40 user nova-compute[75102]: INFO nova.compute.manager [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Terminating instance
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.compute.manager [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.compute.manager [req-3f4a8742-0680-4ce2-839e-4c3c0b827a35 req-aca90ac1-c932-4b31-9426-44b6a9ce3964 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-unplugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3f4a8742-0680-4ce2-839e-4c3c0b827a35 req-aca90ac1-c932-4b31-9426-44b6a9ce3964 service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3f4a8742-0680-4ce2-839e-4c3c0b827a35 req-aca90ac1-c932-4b31-9426-44b6a9ce3964 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-3f4a8742-0680-4ce2-839e-4c3c0b827a35 req-aca90ac1-c932-4b31-9426-44b6a9ce3964 service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.compute.manager [req-3f4a8742-0680-4ce2-839e-4c3c0b827a35 req-aca90ac1-c932-4b31-9426-44b6a9ce3964 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-unplugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.compute.manager [req-3f4a8742-0680-4ce2-839e-4c3c0b827a35 req-aca90ac1-c932-4b31-9426-44b6a9ce3964 service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-unplugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Instance destroyed successfully.
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.objects.instance [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'resources' on Instance uuid c9fc7541-3321-4340-830f-c73af84d428b {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:54:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1770642413',display_name='tempest-ServerRescueNegativeTestJSON-server-1770642413',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1770642413',id=52,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOMXtOBIgEpFHGQuo9Gj11BIKfbDZECAdmouNryZL79YX1sTu6Dy+EnPTXL60WtAyNV0nrLJnO119tFrIdluOcy+8GhV+u6aEnuulBFfk0z+3DNKmD5fUJla9GkPR7Zc2g==',key_name='tempest-keypair-1195217145',keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:57:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-u3ko2vcn',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:59:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=c9fc7541-3321-4340-830f-c73af84d428b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "address": "fa:16:3e:d1:9d:1b", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.47", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3e0148c0-ca", "ovs_interfaceid": "3e0148c0-ca8c-442f-9b7f-e7b063fefb7e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e0148c0-ca8c-442f-9b7f-e7b063fefb7e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0148c0-ca') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG os_vif [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e0148c0-ca8c-442f-9b7f-e7b063fefb7e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0148c0-ca') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3e0148c0-ca, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b6efca50-df3a-481a-94a7-dc375d915ab7) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:01:40 user nova-compute[75102]: INFO os_vif [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:9d:1b,bridge_name='br-int',has_traffic_filtering=True,id=3e0148c0-ca8c-442f-9b7f-e7b063fefb7e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3e0148c0-ca')
Nov 10 17:01:40 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Deleting instance files /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b_del
Nov 10 17:01:40 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Deletion of /opt/stack/data/nova/instances/c9fc7541-3321-4340-830f-c73af84d428b_del complete
Nov 10 17:01:40 user nova-compute[75102]: INFO nova.compute.manager [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 10 17:01:40 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:01:40 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: c9fc7541-3321-4340-830f-c73af84d428b] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:01:41 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:01:41 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Took 0.75 seconds to deallocate network for instance.
Nov 10 17:01:41 user nova-compute[75102]: DEBUG nova.compute.manager [req-26e2b851-2dce-4d48-b4b7-4a0d2d290afc req-621d2c56-ff62-496e-9fb0-87a43c359f7e service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-deleted-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:01:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:01:41 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:01:41 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:01:41 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:01:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.453s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:01:42 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Deleted allocations for instance c9fc7541-3321-4340-830f-c73af84d428b
Nov 10 17:01:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-03a859ef-13ce-4587-bb5d-dedd4ba10a96 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "c9fc7541-3321-4340-830f-c73af84d428b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.252s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:01:42 user nova-compute[75102]: DEBUG nova.compute.manager [req-8a3c04ca-b3e9-45af-bfc8-bbfb2c36ca7e req-99a42705-ac38-4bdd-9e62-b2b55705967a service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:01:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8a3c04ca-b3e9-45af-bfc8-bbfb2c36ca7e req-99a42705-ac38-4bdd-9e62-b2b55705967a service nova] Acquiring lock "c9fc7541-3321-4340-830f-c73af84d428b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:01:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8a3c04ca-b3e9-45af-bfc8-bbfb2c36ca7e req-99a42705-ac38-4bdd-9e62-b2b55705967a service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:01:42 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8a3c04ca-b3e9-45af-bfc8-bbfb2c36ca7e req-99a42705-ac38-4bdd-9e62-b2b55705967a service nova] Lock "c9fc7541-3321-4340-830f-c73af84d428b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:01:42 user nova-compute[75102]: DEBUG nova.compute.manager [req-8a3c04ca-b3e9-45af-bfc8-bbfb2c36ca7e req-99a42705-ac38-4bdd-9e62-b2b55705967a service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] No waiting events found dispatching network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:01:42 user nova-compute[75102]: WARNING nova.compute.manager [req-8a3c04ca-b3e9-45af-bfc8-bbfb2c36ca7e req-99a42705-ac38-4bdd-9e62-b2b55705967a service nova] [instance: c9fc7541-3321-4340-830f-c73af84d428b] Received unexpected event network-vif-plugged-3e0148c0-ca8c-442f-9b7f-e7b063fefb7e for instance with vm_state deleted and task_state None.
Nov 10 17:01:45 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:01:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:01:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:01:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:01:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:01:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:00 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:02:05 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:10 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:02:15 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:02:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:02:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:02:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:02:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:02:20 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:02:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:02:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:02:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:02:25 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:02:29 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:02:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:02:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:02:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:02:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:02:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:02:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:02:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:31 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:02:31 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8886MB free_disk=25.040164947509766GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance d70f5eeb-42bd-4612-8103-9e5bc8950cea actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:02:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.618s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:02:33 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:02:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:02:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 10 17:02:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquired lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 10 17:02:33 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Forcefully refreshing network info cache for instance {{(pid=75102) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 10 17:02:33 user nova-compute[75102]: DEBUG nova.objects.instance [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lazy-loading 'info_cache' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:02:34 user nova-compute[75102]: DEBUG nova.network.neutron [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [{"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:02:34 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Releasing lock "refresh_cache-fcd9ad66-cdd7-4016-9204-d2b0f40a1718" {{(pid=75102) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 10 17:02:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updated the network info_cache for instance {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 10 17:02:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:02:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:36 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:02:41 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:45 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:02:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:02:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:02:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:02:46 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:02:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:47 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 17:02:51 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:02:53 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:02:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 17:02:53 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 17:02:56 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:01 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:06 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:06 user nova-compute[75102]: INFO nova.compute.manager [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Terminating instance
Nov 10 17:03:06 user nova-compute[75102]: DEBUG nova.compute.manager [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:03:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:06 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-25657f09-e9ae-45de-a3c6-c3700d78211b req-2fa4e4ac-0e2c-410a-bbfe-8203e427f435 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-unplugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25657f09-e9ae-45de-a3c6-c3700d78211b req-2fa4e4ac-0e2c-410a-bbfe-8203e427f435 service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25657f09-e9ae-45de-a3c6-c3700d78211b req-2fa4e4ac-0e2c-410a-bbfe-8203e427f435 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25657f09-e9ae-45de-a3c6-c3700d78211b req-2fa4e4ac-0e2c-410a-bbfe-8203e427f435 service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-25657f09-e9ae-45de-a3c6-c3700d78211b req-2fa4e4ac-0e2c-410a-bbfe-8203e427f435 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-unplugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG nova.compute.manager [req-25657f09-e9ae-45de-a3c6-c3700d78211b req-2fa4e4ac-0e2c-410a-bbfe-8203e427f435 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-unplugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Instance destroyed successfully.
Nov 10 17:03:07 user nova-compute[75102]: DEBUG nova.objects.instance [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'resources' on Instance uuid d70f5eeb-42bd-4612-8103-9e5bc8950cea {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:46:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1143453276',display_name='tempest-ServerRescueNegativeTestJSON-server-1143453276',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1143453276',id=47,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:48:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-d8hc0fdk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:48:07Z,user_data=None,user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=d70f5eeb-42bd-4612-8103-9e5bc8950cea,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "address": "fa:16:3e:15:5a:30", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape902d3a4-bc", "ovs_interfaceid": "e902d3a4-bca2-4364-aad8-a4fb12d69d31", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:5a:30,bridge_name='br-int',has_traffic_filtering=True,id=e902d3a4-bca2-4364-aad8-a4fb12d69d31,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape902d3a4-bc') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG os_vif [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:5a:30,bridge_name='br-int',has_traffic_filtering=True,id=e902d3a4-bca2-4364-aad8-a4fb12d69d31,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape902d3a4-bc') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape902d3a4-bc, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2e4c62d6-18d3-4dfa-abe9-086acf89cbef) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: INFO os_vif [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:5a:30,bridge_name='br-int',has_traffic_filtering=True,id=e902d3a4-bca2-4364-aad8-a4fb12d69d31,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape902d3a4-bc')
Nov 10 17:03:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Deleting instance files /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea_del
Nov 10 17:03:07 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Deletion of /opt/stack/data/nova/instances/d70f5eeb-42bd-4612-8103-9e5bc8950cea_del complete
Nov 10 17:03:07 user nova-compute[75102]: INFO nova.compute.manager [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 10 17:03:07 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:07 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:08 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:03:08 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Took 0.48 seconds to deallocate network for instance.
Nov 10 17:03:08 user nova-compute[75102]: DEBUG nova.compute.manager [req-8c06e7c6-8035-45d3-854a-ed960a88ef55 req-95e556cf-d120-432f-ba95-ce1aaab82398 service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-deleted-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:08 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:03:08 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:03:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.160s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:08 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Deleted allocations for instance d70f5eeb-42bd-4612-8103-9e5bc8950cea
Nov 10 17:03:08 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-ed5284d1-6e66-49db-a01b-66b946f899bd tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.801s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:09 user nova-compute[75102]: WARNING nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state deleted and task_state None.
Nov 10 17:03:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:09 user nova-compute[75102]: WARNING nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state deleted and task_state None.
Nov 10 17:03:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:09 user nova-compute[75102]: WARNING nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state deleted and task_state None.
Nov 10 17:03:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Acquiring lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] Lock "d70f5eeb-42bd-4612-8103-9e5bc8950cea-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:09 user nova-compute[75102]: DEBUG nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] No waiting events found dispatching network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:09 user nova-compute[75102]: WARNING nova.compute.manager [req-8f388140-27cb-4c8d-a5c4-ad11b3f1191a req-93c77e6c-3020-4a94-a501-14a8eac3438d service nova] [instance: d70f5eeb-42bd-4612-8103-9e5bc8950cea] Received unexpected event network-vif-plugged-e902d3a4-bca2-4364-aad8-a4fb12d69d31 for instance with vm_state deleted and task_state None.
Nov 10 17:03:12 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:03:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:17 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:03:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:22 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:27 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:03:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:27 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:30 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:03:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:03:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:03:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 10 17:03:30 user nova-compute[75102]: DEBUG oslo_concurrency.processutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75102) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 10 17:03:31 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:03:31 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:03:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=8952MB free_disk=25.067344665527344GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:03:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75102) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 10 17:03:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:03:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:03:31 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:03:31 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:03:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:03:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.194s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:03:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:03:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:03:32 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:03:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:37 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:03:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:42 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:47 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:03:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:03:52 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:57 user nova-compute[75102]: INFO nova.compute.manager [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Terminating instance
Nov 10 17:03:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Start destroying the instance on the hypervisor. {{(pid=75102) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_power_states {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-9ddfb512-a9e6-47fc-9a94-42962992949b req-d0a0ff2e-10f7-43b8-ae5b-f223223fb9dd service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9ddfb512-a9e6-47fc-9a94-42962992949b req-d0a0ff2e-10f7-43b8-ae5b-f223223fb9dd service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9ddfb512-a9e6-47fc-9a94-42962992949b req-d0a0ff2e-10f7-43b8-ae5b-f223223fb9dd service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-9ddfb512-a9e6-47fc-9a94-42962992949b req-d0a0ff2e-10f7-43b8-ae5b-f223223fb9dd service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-9ddfb512-a9e6-47fc-9a94-42962992949b req-d0a0ff2e-10f7-43b8-ae5b-f223223fb9dd service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG nova.compute.manager [req-9ddfb512-a9e6-47fc-9a94-42962992949b req-d0a0ff2e-10f7-43b8-ae5b-f223223fb9dd service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with task_state deleting. {{(pid=75102) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Triggering sync for uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:57 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: INFO nova.virt.libvirt.driver [-] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Instance destroyed successfully.
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.objects.instance [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lazy-loading 'resources' on Instance uuid fcd9ad66-cdd7-4016-9204-d2b0f40a1718 {{(pid=75102) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.virt.libvirt.vif [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-10T16:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-813594258',display_name='tempest-ServerRescueNegativeTestJSON-server-813594258',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-813594258',id=46,image_ref='a26f5e2e-1666-4272-b064-065539894418',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-10T16:51:03Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea704446109948239b67b37c01c2c146',ramdisk_id='',reservation_id='r-p0gvaucu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a26f5e2e-1666-4272-b064-065539894418',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-662150154',owner_user_name='tempest-ServerRescueNegativeTestJSON-662150154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-10T16:52:54Z,user_data=None,user_id='cd7ddbca327e4e2893563e02cd3d3754',uuid=fcd9ad66-cdd7-4016-9204-d2b0f40a1718,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converting VIF {"id": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "address": "fa:16:3e:6a:7c:bb", "network": {"id": "525286c8-a4d5-4382-8a3a-783f47f2e512", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1058488836-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea704446109948239b67b37c01c2c146", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap000d56c3-20", "ovs_interfaceid": "000d56c3-206f-46d9-a7a3-550d2b5a947e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.network.os_vif_util [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7c:bb,bridge_name='br-int',has_traffic_filtering=True,id=000d56c3-206f-46d9-a7a3-550d2b5a947e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap000d56c3-20') {{(pid=75102) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG os_vif [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7c:bb,bridge_name='br-int',has_traffic_filtering=True,id=000d56c3-206f-46d9-a7a3-550d2b5a947e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap000d56c3-20') {{(pid=75102) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap000d56c3-20, bridge=br-int, if_exists=True) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 19 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=48b3706d-53d5-4948-8f14-a109d73eb231) {{(pid=75102) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:03:58 user nova-compute[75102]: INFO os_vif [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:6a:7c:bb,bridge_name='br-int',has_traffic_filtering=True,id=000d56c3-206f-46d9-a7a3-550d2b5a947e,network=Network(525286c8-a4d5-4382-8a3a-783f47f2e512),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap000d56c3-20')
Nov 10 17:03:58 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Deleting instance files /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718_del
Nov 10 17:03:58 user nova-compute[75102]: INFO nova.virt.libvirt.driver [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Deletion of /opt/stack/data/nova/instances/fcd9ad66-cdd7-4016-9204-d2b0f40a1718_del complete
Nov 10 17:03:58 user nova-compute[75102]: INFO nova.compute.manager [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 10 17:03:58 user nova-compute[75102]: DEBUG oslo.service.loopingcall [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75102) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.compute.manager [-] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Deallocating network for instance {{(pid=75102) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] deallocate_for_instance() {{(pid=75102) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.network.neutron [-] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Updating instance_info_cache with network_info: [] {{(pid=75102) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 10 17:03:58 user nova-compute[75102]: INFO nova.compute.manager [-] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Took 0.48 seconds to deallocate network for instance.
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.compute.manager [req-8fe376f8-5f03-4e3d-86da-e70e8dc040d8 req-4444c932-c411-4e36-9898-56406f2ce4e7 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-deleted-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.120s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:58 user nova-compute[75102]: INFO nova.scheduler.client.report [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Deleted allocations for instance fcd9ad66-cdd7-4016-9204-d2b0f40a1718
Nov 10 17:03:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-9992e947-fe98-4c71-872c-ed1de181c287 tempest-ServerRescueNegativeTestJSON-662150154 tempest-ServerRescueNegativeTestJSON-662150154-project-member] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.654s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 1.237s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:58 user nova-compute[75102]: INFO nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 10 17:03:58 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:59 user nova-compute[75102]: WARNING nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state deleted and task_state None.
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:59 user nova-compute[75102]: WARNING nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state deleted and task_state None.
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:59 user nova-compute[75102]: WARNING nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state deleted and task_state None.
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:59 user nova-compute[75102]: WARNING nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-unplugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state deleted and task_state None.
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Acquiring lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] Lock "fcd9ad66-cdd7-4016-9204-d2b0f40a1718-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:03:59 user nova-compute[75102]: DEBUG nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] No waiting events found dispatching network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e {{(pid=75102) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 10 17:03:59 user nova-compute[75102]: WARNING nova.compute.manager [req-25e6d25b-3ebc-4c60-b3d3-d4111604f0bc req-b19ec153-796b-4371-a883-1d5dbc215dd1 service nova] [instance: fcd9ad66-cdd7-4016-9204-d2b0f40a1718] Received unexpected event network-vif-plugged-000d56c3-206f-46d9-a7a3-550d2b5a947e for instance with vm_state deleted and task_state None.
Nov 10 17:04:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:28 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:29 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:04:30 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:04:30 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:04:30 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=9062MB free_disk=25.094764709472656GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:04:30 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:04:31 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:04:31 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:04:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:04:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:04:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:04:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:32 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:04:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:04:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:04:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:04:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:04:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:37 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:04:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:50 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:04:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:05:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:05:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:05:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:05:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:05:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:05:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:30 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:05:31 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:05:31 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:05:31 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:05:31 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:05:31 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:05:32 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:05:32 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:05:32 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=9099MB free_disk=25.0933837890625GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:05:32 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.107s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:05:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:05:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:05:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:05:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:05:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:05:36 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:05:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:05:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:05:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:05:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:38 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:05:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:05:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:05:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:05:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:05:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:05:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:05:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:05:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:05:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:24 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:06:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:31 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:06:33 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:06:33 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=9113MB free_disk=25.09223175048828GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:06:33 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.115s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:06:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:34 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:06:37 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:37 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:37 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:06:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:38 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:06:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:06:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:06:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:06:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:06:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:06:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:06:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:07:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:07:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:07:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:32 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:07:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:07:35 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:07:35 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:07:35 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=25.074913024902344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:07:35 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing inventories for resource provider fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating ProviderTree inventory for provider fe24d663-5905-4042-a478-befa03efc244 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Updating inventory in ProviderTree for provider fe24d663-5905-4042-a478-befa03efc244 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing aggregate associations for resource provider fe24d663-5905-4042-a478-befa03efc244, aggregates: None {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Refreshing trait associations for resource provider fe24d663-5905-4042-a478-befa03efc244, traits: COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE,COMPUTE_IMAGE_TYPE_ISO,HW_CPU_X86_MMX,COMPUTE_STORAGE_BUS_USB,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_GRAPHICS_MODEL_BOCHS,HW_CPU_X86_SSSE3,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_VIOMMU_MODEL_INTEL,HW_CPU_X86_SSE41,HW_CPU_X86_SSE2,COMPUTE_NODE,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_TRUSTED_CERTS,COMPUTE_STORAGE_BUS_IDE,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_VOLUME_EXTEND,COMPUTE_ACCELERATORS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_PCNET,HW_CPU_X86_SSE42,COMPUTE_STORAGE_BUS_SATA {{(pid=75102) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:07:36 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.418s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:07:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:07:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:38 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:39 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:40 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:07:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:46 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:47 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:07:47 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances with incomplete migration  {{(pid=75102) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 10 17:07:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:07:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:07:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:07:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:07:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:00 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Cleaning up deleted instances {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 10 17:08:00 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] There are 0 instances to clean {{(pid=75102) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 10 17:08:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:08:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:08:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:08:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:08:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:25 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:08:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:33 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:08:37 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:08:37 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=9094MB free_disk=25.073753356933594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:08:37 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.131s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:08:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:08:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:39 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:40 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:08:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:08:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:08:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:08:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:08:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:08:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:09:23 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:09:26 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:09:28 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:09:33 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:09:34 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:09:35 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager.update_available_resource {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Auditing locally available compute resources for user (node: user) {{(pid=75102) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 10 17:09:38 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:09:38 user nova-compute[75102]: WARNING nova.virt.libvirt.driver [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 10 17:09:38 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=25.07247543334961GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75102) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75102) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG nova.compute.provider_tree [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed in ProviderTree for provider: fe24d663-5905-4042-a478-befa03efc244 {{(pid=75102) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG nova.scheduler.client.report [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Inventory has not changed for provider fe24d663-5905-4042-a478-befa03efc244 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75102) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG nova.compute.resource_tracker [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Compute_service record updated for user:user {{(pid=75102) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 10 17:09:38 user nova-compute[75102]: DEBUG oslo_concurrency.lockutils [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.117s {{(pid=75102) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 10 17:09:39 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:09:39 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Starting heal instance info cache {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 10 17:09:39 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Rebuilding the list of instances to heal {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 10 17:09:39 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Didn't find any instances for network info cache update. {{(pid=75102) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 10 17:09:39 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:09:39 user nova-compute[75102]: DEBUG nova.compute.manager [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75102) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 10 17:09:40 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:09:41 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:09:42 user nova-compute[75102]: DEBUG oslo_service.periodic_task [None req-786cc7b5-1913-4418-995d-fa83e881e18a None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75102) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 10 17:09:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:09:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:09:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:09:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:09:43 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:09:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:09:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:09:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:09:48 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:09:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:09:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:09:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:09:53 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:55 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:09:58 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:10:03 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:10:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:10:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:10:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:10:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:10:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:10:08 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:10:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 10 17:10:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:10:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75102) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 10 17:10:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:10:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75102) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 10 17:10:13 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 10 17:10:18 user nova-compute[75102]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 24 {{(pid=75102) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}